-- Logs begin at Sun 2022-09-04 15:24:04 UTC, end at Sun 2022-09-04 16:34:53 UTC. -- Sep 04 16:05:10.352270 dv-cinder-852364-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 04 16:05:10.360930 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 04 16:05:10.362944 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 4 16:05:10 2022] *** Sep 04 16:05:10.362944 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 04 16:05:10.362944 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 04 16:05:10.362944 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: nodename: dv-cinder-852364-6-iscsi Sep 04 16:05:10.362944 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: machine: x86_64 Sep 04 16:05:10.362944 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: clock source: unix Sep 04 16:05:10.362944 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: pcre jit disabled Sep 04 16:05:10.362944 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: detected number of CPU cores: 4 Sep 04 16:05:10.362944 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: current working directory: / Sep 04 16:05:10.362944 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: detected binary path: /usr/bin/uwsgi-core Sep 04 16:05:10.363703 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: your processes number limit is 47680 Sep 04 16:05:10.363703 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: your memory page size is 4096 bytes Sep 04 16:05:10.363703 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: detected max file descriptor number: 2048 Sep 04 16:05:10.363703 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: lock engine: pthread robust mutexes Sep 04 16:05:10.363703 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: thunder lock: enabled Sep 04 16:05:10.363703 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 04 16:05:10.363703 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 04 16:05:10.402359 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: Python main interpreter initialized at 0x5580811529c0 Sep 04 16:05:10.402359 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: python threads support enabled Sep 04 16:05:10.402359 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: your server socket listen backlog is limited to 100 connections Sep 04 16:05:10.402359 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: your mercy for graceful operations on workers is 90 seconds Sep 04 16:05:10.402688 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: mapped 403077 bytes (393 KB) for 2 cores Sep 04 16:05:10.402763 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: *** Operational MODE: preforking *** Sep 04 16:05:10.403021 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: *** uWSGI is running in multiple interpreter mode *** Sep 04 16:05:10.403021 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: spawned uWSGI master process (pid: 106057) Sep 04 16:05:10.403222 dv-cinder-852364-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 04 16:05:10.404636 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: spawned uWSGI worker 1 (pid: 106058, cores: 1) Sep 04 16:05:10.404636 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: spawned uWSGI worker 2 (pid: 106059, cores: 1) Sep 04 16:05:10.404636 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 04 16:05:11.064710 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 04 16:05:11.091976 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 04 16:05:12.195959 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 04 16:05:12.195959 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: from cryptography.utils import int_from_bytes Sep 04 16:05:12.196684 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 04 16:05:12.196684 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: from cryptography.utils import int_from_bytes Sep 04 16:05:12.212714 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 04 16:05:12.212714 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: from cryptography.utils import int_from_bytes Sep 04 16:05:12.213156 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 04 16:05:12.213156 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: from cryptography.utils import int_from_bytes Sep 04 16:05:14.702970 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 04 16:05:14.703584 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 04 16:05:14.703584 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 04 16:05:14.704000 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 04 16:05:14.704092 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 04 16:05:14.704179 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 04 16:05:14.704263 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 04 16:05:14.704341 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 04 16:05:14.704424 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 04 16:05:14.704507 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 04 16:05:14.704602 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.704680 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.704930 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.705027 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.705248 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.705348 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.705582 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.705680 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.705920 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.706017 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.706230 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.706315 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.706549 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.706632 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.706862 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.706943 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.707185 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.707278 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.707442 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.708046 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.708372 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.708534 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.708825 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852364-6-iscsi {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.708954 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852364-6-iscsi {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.709324 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.709413 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.709662 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.709766 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.709976 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.710058 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.710295 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.710379 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.710601 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.710691 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.710922 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.711004 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.711232 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.711386 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.711730 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.711894 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.712898 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.713074 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.713212 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.713309 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.713400 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.713485 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.713578 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.713658 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.713783 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.713877 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.713877 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.714066 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.714146 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.714222 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.714343 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.714436 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.714609 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.714700 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.714915 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.714999 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.715307 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852364-6-iscsi {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.715392 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852364-6-iscsi {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.715622 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.715713 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.715931 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.716020 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.716243 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.716331 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.716650 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.716750 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.716960 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.717042 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.717266 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.717348 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.717603 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.717743 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.717931 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.718039 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.718236 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.718328 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.718562 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.718659 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.718876 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.718971 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.719192 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.719285 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.719508 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.719642 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.719809 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.719893 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.720112 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.720195 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.720417 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.720500 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.720732 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.720822 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.721034 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.721118 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.721335 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.721425 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.721600 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.721703 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.721911 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.721995 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.722229 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.722355 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.722546 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.722642 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.722864 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.722956 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.723113 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.723812 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.723949 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.724037 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.724368 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.724576 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.724692 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.724908 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.724994 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.725222 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.725307 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.725534 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.725699 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.725864 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.725947 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.726180 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.726265 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.726489 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.726573 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.726791 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.726875 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.727093 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.727176 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.727400 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.727490 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.727712 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.727802 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.728024 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.728108 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.728328 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.728420 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.728646 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.728772 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.728962 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.729046 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.729276 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.729371 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.729616 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.729705 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.729917 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.730000 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.730241 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.730343 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.730550 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.730635 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.730856 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.730947 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.731173 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.731266 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.731477 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.731560 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.731781 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.731866 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.732085 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.732168 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.732394 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.732486 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.732714 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.732798 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.733025 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.733107 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.733277 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.733368 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.733582 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.733677 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.733898 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.733990 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.734202 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.734284 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.734509 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.734592 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.734815 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.734905 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.735118 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.735202 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.735418 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.735513 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.735715 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.735798 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.736016 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.736099 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.736320 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.736411 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.736621 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.736704 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.736927 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.737019 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.737227 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.737319 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.737528 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.737641 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.737855 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.737938 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.738158 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.738255 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.738461 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.738546 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.738795 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.738890 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.739110 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.739293 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.739455 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.739727 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.739819 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.740040 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.740125 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.740350 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.740436 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.740658 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.740743 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.740968 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.741052 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.741290 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.741375 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.741618 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.741706 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.741930 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.742015 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.742234 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.742320 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.742546 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.742635 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.742851 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.742963 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.743157 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.743244 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.743459 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.743542 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.743761 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.743851 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.744065 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.744149 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.744362 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.744444 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.744668 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.744767 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.744970 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.745060 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.745270 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.745354 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.745589 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.745688 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.745897 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.745988 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.746199 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.746281 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.746497 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.746588 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.746799 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.746883 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.747100 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.747190 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.747407 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.747500 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.747706 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.747790 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.748016 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.748099 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.748324 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.748409 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.748627 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.748711 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.748929 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.749023 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.749236 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.749321 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.749552 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:05:14.749667 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.749910 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.749994 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.750244 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.750328 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.750579 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.750664 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.750893 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.750984 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.751217 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.751345 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.751533 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.751617 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.751847 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.751939 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.752158 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.752289 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.752473 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.752556 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.752788 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.752957 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.753096 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.753178 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.753410 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.753503 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.753750 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.753865 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.754070 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.754156 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.754388 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.754516 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.754794 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.754891 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.755151 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.755463 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.755562 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.756038 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.756300 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.756386 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.756640 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.756726 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.756962 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.757053 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.757289 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.757374 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.757710 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.757811 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.758030 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.758114 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.758352 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.758443 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.758672 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.758764 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.758985 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.759070 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.759297 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.759382 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.759638 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.759731 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.759947 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.760039 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.760257 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.760340 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.760567 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.760650 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.760876 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.760968 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.761186 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.761270 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.761510 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.761624 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.761849 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.761947 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.762160 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.762245 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.762471 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.762557 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.762788 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.762932 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.763099 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.763183 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.763408 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.763491 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.763721 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.763806 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.764035 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.764119 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.764346 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.764430 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.764657 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.764740 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.764976 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.765061 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.765289 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.765373 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.765622 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.765710 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.765936 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.766019 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.766243 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.766328 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.766548 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.766632 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.766852 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.766946 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.767161 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.767245 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.767462 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.767606 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.767764 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.767856 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.768072 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.768166 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.768388 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.768472 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.768693 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.768779 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.769010 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.769100 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.769322 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.769428 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.769656 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.769759 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.769967 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.770554 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.770823 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.771018 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.771139 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.771451 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.771609 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.771760 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.772064 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.772161 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.772383 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.772509 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.772691 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.772776 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.773008 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.773107 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.773315 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.773406 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.773648 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.773735 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.773965 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.774048 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.774277 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.774362 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.774584 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.774668 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.774895 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.774978 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.775204 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.775287 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.775515 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.775601 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.775825 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.775916 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.776136 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.776232 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.776449 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.776532 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.776764 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.776855 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.777078 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.777234 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.777403 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.777487 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.777745 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.777832 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.778061 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.778155 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.778363 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.778446 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.778672 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.778756 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.778977 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.779069 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.779285 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.779381 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.779586 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.779678 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.779893 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.779979 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.780196 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.780281 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.780499 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.780583 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.780801 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.780887 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.781102 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.781187 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.781405 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.781488 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.781744 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.781831 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.782050 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.782135 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.782352 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.782438 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.782656 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.782750 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.782959 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.783090 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.783267 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.783360 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.783591 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.783674 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.783902 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.783996 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.784209 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.784302 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.784514 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.784606 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.784818 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.784903 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.785160 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.785253 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.785466 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.785548 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.786384 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.786561 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.786699 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.787017 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.787142 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.787324 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.787450 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.787643 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.787779 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.787956 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.788097 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.788276 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.788419 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.788585 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.788734 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.788906 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.789056 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.789217 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.789377 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.789539 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.789696 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.789864 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.790024 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.790178 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.790339 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.790519 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.790663 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.790851 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.790977 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.791166 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.791301 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.791489 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.791612 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.791804 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.791926 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.792117 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.792215 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.792425 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.792514 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.792736 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.792858 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.793063 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.793192 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.793355 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.793508 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.793694 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.793866 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.794005 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.794179 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.794321 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.794496 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.794630 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.794807 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.794951 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.795118 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.795260 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.795428 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.795578 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.795738 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.795881 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.796059 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.796192 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.796371 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.796519 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.796693 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.796854 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.797000 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.797163 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.797322 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.797473 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.797655 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.797817 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.797977 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.798130 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.798281 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.798439 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.798596 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.798746 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.798928 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.799049 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.799259 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.799346 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.799572 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.799669 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.799887 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.799982 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.800209 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.800296 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.800521 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.800616 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.800820 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.800907 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.801131 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.801216 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.801464 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.801557 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.801796 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.802023 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.802182 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.802343 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.802495 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.802663 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.802832 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.802978 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.803130 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.803293 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.803454 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.803599 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.803775 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.803916 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.804080 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.804230 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.804383 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.804536 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.804704 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.804843 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.805011 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.805193 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.805357 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.805505 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.805663 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.805807 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.805945 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.806130 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.806289 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.806450 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.806598 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.806758 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.806907 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.807060 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.807223 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.807380 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.807526 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.807690 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.807835 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.807996 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.808147 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.808301 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.808453 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.808606 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.808759 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.808953 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.809079 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.809263 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.809391 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.809599 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.809726 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.809912 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.810037 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.810233 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.810350 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.810543 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.810658 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.810858 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.810967 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.811186 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.811303 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.811484 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.811589 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.811802 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.811897 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.812115 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.812202 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.812426 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.812522 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.812735 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.812831 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.813048 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.813191 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.813356 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.813642 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.813734 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.813976 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.814074 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.814292 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.814381 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.814600 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.814687 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.814909 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.815005 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.815213 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.815311 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.815521 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.815618 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.815837 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.815925 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.816173 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.816403 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.816499 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.816741 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.816830 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.817110 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.817211 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.817414 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.817721 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.817824 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.818107 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.818204 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.818434 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.818524 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.818739 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.818833 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.819051 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.819139 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.819358 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.819452 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.819662 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.819797 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.819968 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.820056 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.820274 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.820362 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.820589 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.820683 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.820891 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.820976 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.821195 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.821280 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.821498 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.821625 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.821833 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.821921 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.822144 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.822228 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.822447 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.822535 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.822750 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.822836 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.823106 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.823204 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.823352 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.823428 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.823668 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.823756 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.823973 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.824060 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.824286 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.824378 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.824590 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.824684 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.824909 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.824996 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.825218 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.825313 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.825523 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.825648 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.825854 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.825950 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.826159 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.826251 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.826464 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.826550 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.826772 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.826873 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.827080 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.827167 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.827383 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.827470 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.827694 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.827798 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.828001 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.828135 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.828309 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.828396 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.828616 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.828713 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.828918 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.829014 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.829223 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.829315 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.829523 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.829647 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.829857 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.829943 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.830164 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.830256 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.830466 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.830552 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.830767 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.830852 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.831073 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.831158 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.831376 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.831471 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.831676 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.831771 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.831977 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.832064 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.832276 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.832363 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.833106 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.833256 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.833493 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.833701 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.833824 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.834093 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.834182 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.834405 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.834499 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.834713 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.834815 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.835013 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.835099 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.835323 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.835410 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.835628 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.835717 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.835929 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.836015 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.836231 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.836316 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.836536 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.836622 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.836838 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.836941 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.837141 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.837250 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.837442 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.837528 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.837782 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.837872 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.838093 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.838188 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.838395 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.838484 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.838703 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.838790 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.839006 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.839102 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.839309 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.839395 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.839608 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.839702 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.839913 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.840053 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.840213 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.840308 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.840513 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.840607 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.840809 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.840896 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.841113 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.841208 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.841415 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.841503 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.841760 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.841851 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.842067 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.842154 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.842371 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.842466 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.842671 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.842765 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.842971 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.843056 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.843283 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.843408 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.843586 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.843694 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.843889 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.843984 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.844190 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.844293 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.844495 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.844589 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.844796 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.844889 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.845116 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.845219 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.845426 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.845518 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.845756 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.845853 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.846060 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.846155 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.846363 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.846449 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.846672 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.846756 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.846984 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.847082 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.847290 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.847394 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.847591 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.847689 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.847911 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.848005 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.848309 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.848403 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.848601 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.848926 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.849074 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.849247 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.849332 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.849586 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.849675 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.849893 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.850018 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.850202 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.850295 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.850509 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.850594 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.850814 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.850908 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.851118 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.851209 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.851423 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.851509 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.851734 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.851826 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.852044 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.852135 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.852353 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.852443 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.852663 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.852748 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.852975 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.853061 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.853286 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.853378 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.853607 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.853699 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.853922 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.854025 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.854225 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.854308 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.854530 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.854614 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.854839 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.854924 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.855142 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.855232 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.855450 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.855544 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.855754 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.855846 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.856062 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.856156 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.856369 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.856460 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.856680 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.856791 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.856985 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.857102 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.857313 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.857447 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.857626 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.857714 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.857935 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.858036 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.858257 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.858343 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.858568 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.858653 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.858873 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.858966 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.859182 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.859266 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.859492 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.859617 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.859802 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.859928 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.860106 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.860226 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.860529 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.860613 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.860833 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.860918 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.861137 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.861222 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.861439 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.861522 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.861778 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.861864 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.862081 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.862164 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.862386 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.862471 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.862690 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.862776 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.862994 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.863084 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.863310 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.863405 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.863638 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.863758 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.864644 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.864754 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.865130 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.865283 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.865442 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.865778 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.865867 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.866093 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.866405 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.866502 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.866713 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.866894 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.867018 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.867211 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.867326 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.867541 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.867650 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.867868 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.867952 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.868197 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.868291 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.868505 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.868672 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.868826 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.868985 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.869136 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.869291 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.869459 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.869737 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.869841 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.870051 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.870141 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.870364 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.870467 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.870687 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.870784 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.871010 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.871097 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.871331 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.871416 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.871636 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.871724 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.871951 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.872039 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.872261 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.872349 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.872584 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.872675 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.872907 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.872995 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.873219 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.873315 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.873534 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.873693 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.873866 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.873959 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.874190 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.874287 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.874499 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.874592 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.874804 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.874891 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.875111 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.875206 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.875436 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.875530 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.875741 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.875835 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.876053 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.876142 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.876365 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.876452 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.876672 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.876759 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.876977 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.877066 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.877279 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.877366 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.877623 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.877783 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.877930 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.878064 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.878237 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.878366 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.878552 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.878684 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.878856 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.878983 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.879172 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.879302 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.879538 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.879692 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.879948 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.880076 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.880260 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.880495 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.880875 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.881058 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.881194 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.881384 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.881520 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.881720 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.881807 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.882062 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.882150 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.882363 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.882447 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.882683 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.882766 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.883004 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.883090 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.883313 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.883397 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.883635 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.883755 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.883949 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.884046 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.884253 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.884346 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.884559 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.884653 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.884864 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.884950 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.885188 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.885279 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.885496 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.885613 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.885828 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.885914 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.886139 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.886226 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.886445 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.886538 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.886750 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.886835 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.887053 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.887139 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.887362 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.887449 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.887670 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.887804 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.887971 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.888058 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.888275 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.888362 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.888597 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.888685 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.888901 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.888987 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.889224 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.889310 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.889532 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.889687 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.889863 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.889996 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.890168 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.890279 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.890472 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.890583 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.890813 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.891116 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.891442 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.891717 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.891803 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.892029 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.892121 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.892338 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.892424 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.892646 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.892731 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.892971 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.893054 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.893275 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.893359 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.893610 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.893699 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.893930 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.894067 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.894235 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.894321 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.894541 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.894634 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.894844 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.894936 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.895684 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.895772 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.896005 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.896294 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.896538 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.896639 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.896871 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.896957 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.897191 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.897277 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.897507 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.897629 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.897849 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.897935 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.898164 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.898251 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.898480 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.898575 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.898795 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.898880 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.899109 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.899197 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.899422 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.899509 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.899732 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.899817 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.900050 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.900135 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.900368 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.900454 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.900693 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.900812 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.901032 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.901218 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.901351 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.901547 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.901693 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.901887 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.902011 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.902201 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.902327 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.902516 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.902685 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.902830 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.903001 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.903160 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.903309 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.903442 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.903631 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.903798 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.903949 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.904047 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.904264 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.904355 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.904575 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.904669 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.904887 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.904973 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.905202 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.905287 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.905516 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.905624 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.905855 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.905943 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.906167 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.906259 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.906480 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.906565 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.906795 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.906888 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.907117 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.907202 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.907451 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.907544 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.907764 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.907847 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.908076 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.908161 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.908391 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.908488 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.908705 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.908788 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.909019 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.909217 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.909334 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.909530 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.909664 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.909887 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.909972 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.910213 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.910315 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.910540 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.910730 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.910912 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.911160 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.911406 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.911546 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.911647 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.911856 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.911946 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.912164 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.912268 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.912473 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.912566 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.912781 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.912870 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.913085 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.913182 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.913409 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.913504 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.913746 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.913955 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.914071 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.914274 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.914383 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.914604 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.914692 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.914932 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.915167 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.915264 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.915518 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.915613 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.915835 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.915923 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.916160 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.916248 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.916470 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.916555 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.916776 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.916863 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.917081 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.917175 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.917390 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.917476 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.917722 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.917813 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.918036 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.918183 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.918345 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.918543 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.918671 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.918804 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.918945 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.919087 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.919235 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.919376 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.919534 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.919773 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.919903 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.920121 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.920251 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.920427 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.920560 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.920732 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.920862 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.921059 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.921200 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.921363 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.921492 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.921692 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.921828 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.921998 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.922128 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.922309 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.922444 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.922612 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.922746 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.922915 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.923061 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.923220 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.923362 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.923526 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.923665 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.923835 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.923975 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.924124 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.924260 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.924431 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.924521 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.924732 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.924826 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.925041 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.925134 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.925348 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.925434 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.925700 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.925791 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.926005 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.926098 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.926831 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.926925 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.927141 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.927388 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.927482 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.927724 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.927809 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.928034 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.928126 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.928342 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.928444 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.928649 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.928735 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.928954 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.929037 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.929267 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.929358 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.929582 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.929671 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.929905 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.930138 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.930234 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.930477 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.930563 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.930799 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.930885 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.931135 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.931227 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.931456 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.931540 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.931762 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.931845 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.932071 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.932165 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.932372 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.932456 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.932691 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.932789 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.932998 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.933158 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.933309 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.933395 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.933640 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.933729 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.933951 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.934049 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.934266 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.934351 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.934576 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.934669 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.934883 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.935116 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.935202 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.935453 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.935545 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.935777 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.935870 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.936084 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.936169 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.936389 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.936475 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.936696 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.936789 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.937002 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.937088 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.937310 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.937414 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.937660 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.937749 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.937976 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.938061 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.938289 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.938376 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.938602 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.938731 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.938915 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.938999 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.939225 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.939316 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.939532 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.939631 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.939838 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.939921 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.940142 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.940225 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.940451 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.940535 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.940760 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.940847 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.941075 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.941170 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.941376 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.941468 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.941709 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.942118 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.942206 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.942434 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.942755 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.942847 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.943078 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.943163 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.943392 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.943496 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.943715 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.943800 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.944035 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.944118 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.944344 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.944428 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.944654 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.944737 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.944963 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.945046 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.945270 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.945355 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.945595 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.945683 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.945917 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.946002 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.946248 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.946336 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.946563 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.946648 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.946864 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.946960 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.947169 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.947478 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.947561 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.947794 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.947879 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.948102 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.948187 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.948406 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.948491 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.948707 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.948793 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.949014 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.949108 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.949314 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.949399 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.949644 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.949747 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.949950 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.950043 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.950253 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.950337 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.950560 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.950654 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.950863 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.950957 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.951166 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.951258 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.951471 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.951573 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.951772 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.951858 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.952075 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.952160 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.952376 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.952470 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.952683 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.952778 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.953028 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.953128 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.953287 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.953381 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.953607 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.953697 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.953915 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.954003 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.954222 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.954307 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.954527 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.954613 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.954835 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.954920 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.955139 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.955225 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.955442 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.955526 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.955752 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.955845 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.956056 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.956140 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.956358 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.956451 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.956661 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.956755 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.956966 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.957052 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.957270 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.957354 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.957620 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.957723 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.957955 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.958199 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.958296 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.958565 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.958732 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.958876 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.959186 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.959312 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.959494 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.959807 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.959939 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.960133 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.960245 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.960458 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.960558 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.960764 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.960871 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.961087 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.961184 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.961403 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.961500 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.961761 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.961861 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.962078 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.962162 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.962387 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.962479 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.962704 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.962860 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.963014 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.963098 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.963324 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.963409 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.963633 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.963719 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.963943 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.964027 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.964256 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.964340 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.964572 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.964660 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.964881 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.964966 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.965193 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.965277 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.965504 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.965619 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.965843 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.965927 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.966155 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.966247 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.966483 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.966568 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.966790 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.966881 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.967105 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.967196 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.967430 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.967515 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.967747 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.967833 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.968070 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.968167 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.968388 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.968474 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.968703 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.968803 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.969026 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.969111 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.969336 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.969421 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.969660 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.969747 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.969905 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 04 16:05:14.969992 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.970274 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.970588 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.970921 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.971241 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.971555 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.971872 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.972188 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.972518 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.972845 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.973722 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.974300 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.974737 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.975091 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.975408 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.975754 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.976085 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.976403 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.976718 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.977024 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:05:14.977270 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106059) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 04 16:05:15.123386 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO dbcounter [None req-7267e072-88c0-43e3-b2ce-3fa7ab3bca3a None None] Registered counter for database nova_api Sep 04 16:05:15.131744 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO dbcounter [None req-fc663858-c51a-4e26-8267-a068a00e1721 None None] Registered counter for database nova_api Sep 04 16:05:15.145968 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_db.sqlalchemy.engines [None req-7267e072-88c0-43e3-b2ce-3fa7ab3bca3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 16:05:15.152042 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG oslo_db.sqlalchemy.engines [None req-fc663858-c51a-4e26-8267-a068a00e1721 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 16:05:15.152604 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG dbcounter [-] [106058] Writer thread running {{(pid=106058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 16:05:15.158501 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG dbcounter [-] [106059] Writer thread running {{(pid=106059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 16:05:15.210827 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.context [None req-7267e072-88c0-43e3-b2ce-3fa7ab3bca3a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a86cec77-539a-4bf3-943b-16bf2a859513(cell1) {{(pid=106058) load_cells /opt/stack/nova/nova/context.py:464}} Sep 04 16:05:15.214622 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-7267e072-88c0-43e3-b2ce-3fa7ab3bca3a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:05:15.215102 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-7267e072-88c0-43e3-b2ce-3fa7ab3bca3a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:05:15.216658 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-7267e072-88c0-43e3-b2ce-3fa7ab3bca3a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:05:15.217385 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-7267e072-88c0-43e3-b2ce-3fa7ab3bca3a None None] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:05:15.217853 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-7267e072-88c0-43e3-b2ce-3fa7ab3bca3a None None] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:05:15.219836 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-7267e072-88c0-43e3-b2ce-3fa7ab3bca3a None None] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:05:15.221863 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO dbcounter [None req-7267e072-88c0-43e3-b2ce-3fa7ab3bca3a None None] Registered counter for database nova_cell0 Sep 04 16:05:15.222060 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.context [None req-fc663858-c51a-4e26-8267-a068a00e1721 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a86cec77-539a-4bf3-943b-16bf2a859513(cell1) {{(pid=106059) load_cells /opt/stack/nova/nova/context.py:464}} Sep 04 16:05:15.225923 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO dbcounter [None req-7267e072-88c0-43e3-b2ce-3fa7ab3bca3a None None] Registered counter for database nova_cell1 Sep 04 16:05:15.226437 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG oslo_concurrency.lockutils [None req-fc663858-c51a-4e26-8267-a068a00e1721 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:05:15.226912 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG oslo_concurrency.lockutils [None req-fc663858-c51a-4e26-8267-a068a00e1721 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:05:15.228473 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG oslo_concurrency.lockutils [None req-fc663858-c51a-4e26-8267-a068a00e1721 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:05:15.229214 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG oslo_concurrency.lockutils [None req-fc663858-c51a-4e26-8267-a068a00e1721 None None] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:05:15.229691 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG oslo_concurrency.lockutils [None req-fc663858-c51a-4e26-8267-a068a00e1721 None None] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:05:15.231702 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG oslo_concurrency.lockutils [None req-fc663858-c51a-4e26-8267-a068a00e1721 None None] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106059) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:05:15.232691 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_db.sqlalchemy.engines [None req-7267e072-88c0-43e3-b2ce-3fa7ab3bca3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 16:05:15.233784 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO dbcounter [None req-fc663858-c51a-4e26-8267-a068a00e1721 None None] Registered counter for database nova_cell0 Sep 04 16:05:15.235081 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_db.sqlalchemy.engines [None req-7267e072-88c0-43e3-b2ce-3fa7ab3bca3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 16:05:15.237824 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO dbcounter [None req-fc663858-c51a-4e26-8267-a068a00e1721 None None] Registered counter for database nova_cell1 Sep 04 16:05:15.239397 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG dbcounter [-] [106058] Writer thread running {{(pid=106058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 16:05:15.245385 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG oslo_db.sqlalchemy.engines [None req-fc663858-c51a-4e26-8267-a068a00e1721 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 16:05:15.247535 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG oslo_db.sqlalchemy.engines [None req-fc663858-c51a-4e26-8267-a068a00e1721 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 16:05:15.252872 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG dbcounter [-] [106059] Writer thread running {{(pid=106059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 16:05:15.256392 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG dbcounter [-] [106059] Writer thread running {{(pid=106059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 16:05:15.378208 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG dbcounter [-] [106058] Writer thread running {{(pid=106058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 16:05:15.389248 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO dbcounter [None req-7267e072-88c0-43e3-b2ce-3fa7ab3bca3a None None] Registered counter for database nova_cell0 Sep 04 16:05:15.398168 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_db.sqlalchemy.engines [None req-7267e072-88c0-43e3-b2ce-3fa7ab3bca3a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 16:05:15.402865 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG dbcounter [-] [106058] Writer thread running {{(pid=106058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 16:05:15.403999 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO dbcounter [None req-fc663858-c51a-4e26-8267-a068a00e1721 None None] Registered counter for database nova_cell0 Sep 04 16:05:15.412790 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG oslo_db.sqlalchemy.engines [None req-fc663858-c51a-4e26-8267-a068a00e1721 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106059) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 16:05:15.417444 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG dbcounter [-] [106059] Writer thread running {{(pid=106059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 16:05:15.813791 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: WARNING keystonemiddleware.auth_token [None req-7267e072-88c0-43e3-b2ce-3fa7ab3bca3a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 04 16:05:15.826881 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: WARNING keystonemiddleware.auth_token [None req-7267e072-88c0-43e3-b2ce-3fa7ab3bca3a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 04 16:05:15.837473 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: WARNING keystonemiddleware.auth_token [None req-fc663858-c51a-4e26-8267-a068a00e1721 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 04 16:05:15.844710 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: WARNING keystonemiddleware.auth_token [None req-fc663858-c51a-4e26-8267-a068a00e1721 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 04 16:05:16.171604 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: WARNING keystonemiddleware.auth_token [None req-7267e072-88c0-43e3-b2ce-3fa7ab3bca3a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 04 16:05:16.178207 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: WARNING keystonemiddleware.auth_token [None req-7267e072-88c0-43e3-b2ce-3fa7ab3bca3a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 04 16:05:16.183870 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5580811529c0 pid: 106058 (default app) Sep 04 16:05:16.185946 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-7267e072-88c0-43e3-b2ce-3fa7ab3bca3a None None] Calling method '>' {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:05:16.187120 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-7267e072-88c0-43e3-b2ce-3fa7ab3bca3a None None] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001731 Sep 04 16:05:16.187532 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 788 bytes} [Sun Sep 4 16:05:16 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:05:16.191383 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: WARNING keystonemiddleware.auth_token [None req-fc663858-c51a-4e26-8267-a068a00e1721 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 04 16:05:16.198379 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: WARNING keystonemiddleware.auth_token [None req-fc663858-c51a-4e26-8267-a068a00e1721 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 04 16:05:16.203613 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5580811529c0 pid: 106059 (default app) Sep 04 16:06:37.814590 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-7267e072-88c0-43e3-b2ce-3fa7ab3bca3a None None] Calling method '>' {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:06:37.815642 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-7267e072-88c0-43e3-b2ce-3fa7ab3bca3a None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 04 16:06:37.816029 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 2/2] 10.222.0.39 () {54 vars in 931 bytes} [Sun Sep 4 16:06:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:06:37.834186 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG dbcounter [-] [106059] Writing DB stats nova_api:SELECT=3 {{(pid=106059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:06:37.835338 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG dbcounter [-] [106059] Writing DB stats nova_cell1:SELECT=3 {{(pid=106059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:06:37.836441 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG dbcounter [-] [106059] Writing DB stats nova_cell0:SELECT=3 {{(pid=106059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:06:37.838480 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG dbcounter [-] [106059] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:06:38.723356 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-dafa74f9-c81e-4691-84ae-02e7f98785f5 admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:06:38.755620 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-dafa74f9-c81e-4691-84ae-02e7f98785f5 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.932453 Sep 04 16:06:38.756473 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 1/3] 10.222.0.39 () {60 vars in 1292 bytes} [Sun Sep 4 16:06:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:06:41.148001 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-7267e072-88c0-43e3-b2ce-3fa7ab3bca3a None None] Calling method '>' {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:06:41.148847 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-7267e072-88c0-43e3-b2ce-3fa7ab3bca3a None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Sep 04 16:06:41.157838 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 3/4] 10.222.0.39 () {54 vars in 931 bytes} [Sun Sep 4 16:06:41 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:06:41.593015 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-2b94bab2-8423-446e-9237-ea9abec9ce2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 256, "os-flavor-access:is_public": true, "id": "c1", "swap": 0}} {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:06:41.698056 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-2b94bab2-8423-446e-9237-ea9abec9ce2b admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.542892 Sep 04 16:06:41.698992 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 2/5] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Sep 4 16:06:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:06:41.712606 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG dbcounter [-] [106058] Writing DB stats nova_api:SELECT=3 {{(pid=106058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:06:41.713522 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG dbcounter [-] [106058] Writing DB stats nova_cell1:SELECT=3 {{(pid=106058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:06:41.714690 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG dbcounter [-] [106058] Writing DB stats nova_cell0:SELECT=3 {{(pid=106058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:06:41.715629 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG dbcounter [-] [106058] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:06:41.934778 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-881db1de-9bfc-4a3f-b1fe-2e125eedb289 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:06:42.067701 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-881db1de-9bfc-4a3f-b1fe-2e125eedb289 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.360369 Sep 04 16:06:42.068388 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 4/6] 10.222.0.39 () {64 vars in 1336 bytes} [Sun Sep 4 16:06:41 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:06:44.461096 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-2b94bab2-8423-446e-9237-ea9abec9ce2b admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:06:44.462159 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-2b94bab2-8423-446e-9237-ea9abec9ce2b admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Sep 04 16:06:44.462561 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 3/7] 10.222.0.39 () {54 vars in 931 bytes} [Sun Sep 4 16:06:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:06:45.130450 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-49e7b7c1-c87f-45fb-ab27-266b2aa89847 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 5, "os-flavor-access:is_public": true, "name": "ds512M", "id": "d1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:06:45.249545 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-49e7b7c1-c87f-45fb-ab27-266b2aa89847 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.780632 Sep 04 16:06:45.250518 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 5/8] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Sep 4 16:06:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:06:45.263341 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-3f2bfd26-bd8d-4c37-a2fa-30c8859a53f4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:06:45.373449 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-3f2bfd26-bd8d-4c37-a2fa-30c8859a53f4 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113790 Sep 04 16:06:45.374305 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 4/9] 10.222.0.39 () {64 vars in 1336 bytes} [Sun Sep 4 16:06:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:06:47.746826 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-49e7b7c1-c87f-45fb-ab27-266b2aa89847 admin admin] Calling method '>' {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:06:47.747839 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-49e7b7c1-c87f-45fb-ab27-266b2aa89847 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 04 16:06:47.748528 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 6/10] 10.222.0.39 () {54 vars in 931 bytes} [Sun Sep 4 16:06:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:06:48.143026 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-d8e40eca-1301-4e4e-8a6f-0b867972fd47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "name": "ds1G", "id": "d2", "os-flavor-access:is_public": true}} {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:06:48.226317 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-d8e40eca-1301-4e4e-8a6f-0b867972fd47 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.471314 Sep 04 16:06:48.227021 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 5/11] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Sep 4 16:06:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:06:48.244343 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-3cf3444b-ab83-42bb-92ca-be5c9f93d222 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:06:48.326954 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-3cf3444b-ab83-42bb-92ca-be5c9f93d222 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087109 Sep 04 16:06:48.327547 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 7/12] 10.222.0.39 () {64 vars in 1336 bytes} [Sun Sep 4 16:06:48 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:06:50.713675 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-d8e40eca-1301-4e4e-8a6f-0b867972fd47 admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:06:50.715617 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-d8e40eca-1301-4e4e-8a6f-0b867972fd47 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001583 Sep 04 16:06:50.716988 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 6/13] 10.222.0.39 () {54 vars in 931 bytes} [Sun Sep 4 16:06:50 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:06:51.161453 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-458d4ab6-976a-49aa-8f41-1c2995812d83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0, "disk": 10, "swap": 0, "ram": 2048, "vcpus": 2}} {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:06:51.255988 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-458d4ab6-976a-49aa-8f41-1c2995812d83 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.533055 Sep 04 16:06:51.257202 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 8/14] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Sep 4 16:06:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:06:51.270111 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-f7bb568d-81a0-45ee-8e0b-c000ad130ef4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:06:51.351309 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-f7bb568d-81a0-45ee-8e0b-c000ad130ef4 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085385 Sep 04 16:06:51.351878 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 7/15] 10.222.0.39 () {64 vars in 1336 bytes} [Sun Sep 4 16:06:51 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:06:53.727629 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-458d4ab6-976a-49aa-8f41-1c2995812d83 admin admin] Calling method '>' {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:06:53.728618 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-458d4ab6-976a-49aa-8f41-1c2995812d83 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 04 16:06:53.729178 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 9/16] 10.222.0.39 () {54 vars in 931 bytes} [Sun Sep 4 16:06:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:06:54.178542 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-964bdb67-12d4-4923-9274-78903c57c1e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "ds4G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "disk": 20}} {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:06:54.260227 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-964bdb67-12d4-4923-9274-78903c57c1e8 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.524935 Sep 04 16:06:54.260810 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 8/17] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Sep 4 16:06:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:06:54.273155 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-40fb172f-c955-418b-86d1-3719b1804a21 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:06:54.366771 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-40fb172f-c955-418b-86d1-3719b1804a21 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097303 Sep 04 16:06:54.367677 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 10/18] 10.222.0.39 () {64 vars in 1336 bytes} [Sun Sep 4 16:06:54 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:06:56.862994 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-964bdb67-12d4-4923-9274-78903c57c1e8 admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:06:56.864018 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-964bdb67-12d4-4923-9274-78903c57c1e8 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Sep 04 16:06:56.864420 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 9/19] 10.222.0.39 () {54 vars in 931 bytes} [Sun Sep 4 16:06:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:06:57.327015 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-a5a44b4a-5660-4aee-a373-2420ddc16d04 admin admin] Calling method '>' {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:06:57.352955 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-a5a44b4a-5660-4aee-a373-2420ddc16d04 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.482315 Sep 04 16:06:57.353497 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 11/20] 10.222.0.39 () {60 vars in 1292 bytes} [Sun Sep 4 16:06:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:06:59.783731 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-964bdb67-12d4-4923-9274-78903c57c1e8 admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:06:59.784747 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-964bdb67-12d4-4923-9274-78903c57c1e8 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Sep 04 16:06:59.785151 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 10/21] 10.222.0.39 () {54 vars in 931 bytes} [Sun Sep 4 16:06:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:07:00.242015 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-5ef4b914-0c99-4bce-9e92-424cef0620d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "name": "m1.tiny", "ram": 512, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:07:00.327806 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-5ef4b914-0c99-4bce-9e92-424cef0620d1 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.536349 Sep 04 16:07:00.329171 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 12/22] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Sep 4 16:06:59 2022] POST /compute/v2.1/flavors => generated 402 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:07:00.345510 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-b78057da-95d2-4914-85bf-ac43db73832b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:07:00.458306 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-b78057da-95d2-4914-85bf-ac43db73832b admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120436 Sep 04 16:07:00.458805 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 11/23] 10.222.0.39 () {64 vars in 1333 bytes} [Sun Sep 4 16:07:00 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:07:02.905631 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-5ef4b914-0c99-4bce-9e92-424cef0620d1 admin admin] Calling method '>' {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:02.906644 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-5ef4b914-0c99-4bce-9e92-424cef0620d1 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Sep 04 16:07:02.907040 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 13/24] 10.222.0.39 () {54 vars in 931 bytes} [Sun Sep 4 16:07:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:07:03.286369 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-a5df5806-5022-4684-97cc-1e19898c5478 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "id": "2", "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 20, "rxtx_factor": 1.0}} {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:07:03.368697 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-a5df5806-5022-4684-97cc-1e19898c5478 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.455300 Sep 04 16:07:03.369244 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 12/25] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Sep 4 16:07:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:07:03.382513 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-4fb1a505-87a7-4432-9ab7-4d16ada87c85 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:07:03.568170 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-4fb1a505-87a7-4432-9ab7-4d16ada87c85 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.189866 Sep 04 16:07:03.568766 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 14/26] 10.222.0.39 () {64 vars in 1333 bytes} [Sun Sep 4 16:07:03 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:07:06.061527 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-a5df5806-5022-4684-97cc-1e19898c5478 admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:06.062465 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-a5df5806-5022-4684-97cc-1e19898c5478 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Sep 04 16:07:06.062871 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 13/27] 10.222.0.39 () {54 vars in 931 bytes} [Sun Sep 4 16:07:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:07:06.537924 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-94d785ba-1b31-4ed9-b8f2-3490105b4147 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "m1.medium", "swap": 0, "disk": 40, "rxtx_factor": 1.0, "id": "3", "ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:07:07.134517 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-94d785ba-1b31-4ed9-b8f2-3490105b4147 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 1.064892 Sep 04 16:07:07.137294 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 15/28] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Sep 4 16:07:06 2022] POST /compute/v2.1/flavors => generated 406 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:07:07.152464 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-0ecc66bf-83bd-4f25-9fc8-d6ef6945b4e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:07:07.236887 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-0ecc66bf-83bd-4f25-9fc8-d6ef6945b4e6 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089438 Sep 04 16:07:07.238358 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 14/29] 10.222.0.39 () {64 vars in 1333 bytes} [Sun Sep 4 16:07:07 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:07:09.619593 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-94d785ba-1b31-4ed9-b8f2-3490105b4147 admin admin] Calling method '>' {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:09.620601 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-94d785ba-1b31-4ed9-b8f2-3490105b4147 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 04 16:07:09.620997 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 16/30] 10.222.0.39 () {54 vars in 931 bytes} [Sun Sep 4 16:07:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:07:10.072008 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-113fa5ce-67fa-4aba-a5fb-96fbc54f2829 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "ram": 8192, "disk": 80, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "4"}} {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:07:10.078137 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG dbcounter [-] [106059] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:07:10.157297 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-113fa5ce-67fa-4aba-a5fb-96fbc54f2829 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.529832 Sep 04 16:07:10.163973 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 15/31] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Sep 4 16:07:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:07:10.174068 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-193c6a00-e1cb-4f84-9442-9b1e119e14dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:07:10.281526 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-193c6a00-e1cb-4f84-9442-9b1e119e14dc admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111238 Sep 04 16:07:10.282518 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 17/32] 10.222.0.39 () {64 vars in 1333 bytes} [Sun Sep 4 16:07:10 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:07:12.770320 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-113fa5ce-67fa-4aba-a5fb-96fbc54f2829 admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:12.771332 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-113fa5ce-67fa-4aba-a5fb-96fbc54f2829 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 04 16:07:12.771731 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 16/33] 10.222.0.39 () {54 vars in 931 bytes} [Sun Sep 4 16:07:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:07:13.221044 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-087a71fa-2c34-46a1-a743-a12c105ef9d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "5", "disk": 160, "vcpus": 8, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "ram": 16384}} {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:07:13.372636 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-087a71fa-2c34-46a1-a743-a12c105ef9d8 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.594854 Sep 04 16:07:13.373374 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 18/34] 10.222.0.39 () {64 vars in 1283 bytes} [Sun Sep 4 16:07:12 2022] POST /compute/v2.1/flavors => generated 408 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:07:13.385773 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-adcda035-e991-42e9-90d0-15b9e7d068af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:07:13.487140 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-adcda035-e991-42e9-90d0-15b9e7d068af admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105110 Sep 04 16:07:13.501590 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 17/35] 10.222.0.39 () {64 vars in 1333 bytes} [Sun Sep 4 16:07:13 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:07:31.728112 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-087a71fa-2c34-46a1-a743-a12c105ef9d8 admin admin] Calling method '>' {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:31.729038 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-087a71fa-2c34-46a1-a743-a12c105ef9d8 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 04 16:07:31.729437 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 19/36] 10.222.0.39 () {54 vars in 931 bytes} [Sun Sep 4 16:07:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:07:32.116750 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-6d58fc76-dc2f-4ae3-a9b9-2801fdd07192 admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:32.135055 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-6d58fc76-dc2f-4ae3-a9b9-2801fdd07192 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399577 Sep 04 16:07:32.135567 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 18/37] 10.222.0.39 () {60 vars in 1292 bytes} [Sun Sep 4 16:07:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:07:33.216101 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-087a71fa-2c34-46a1-a743-a12c105ef9d8 admin admin] Calling method '>' {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:33.217103 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-087a71fa-2c34-46a1-a743-a12c105ef9d8 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Sep 04 16:07:33.217494 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 20/38] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Sep 4 16:07:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:07:33.744002 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-7476ac3a-e273-4363-a8f3-39c707b658d9 admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:33.749622 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.wsgi [None req-7476ac3a-e273-4363-a8f3-39c707b658d9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 04 16:07:33.753384 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-7476ac3a-e273-4363-a8f3-39c707b658d9 admin admin] Request method failure captured: Sep 04 16:07:33.753384 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 04 16:07:33.753384 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: Accept: application/json Sep 04 16:07:33.753384 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: Accept-Encoding: gzip, deflate Sep 04 16:07:33.753384 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: Connection: keep-alive Sep 04 16:07:33.753384 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: Content-Length: 0 Sep 04 16:07:33.753384 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: Host: 10.222.0.39 Sep 04 16:07:33.753384 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: Openstack-Api-Version: compute 2.92 Sep 04 16:07:33.753384 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: Openstack-System-Scope: None Sep 04 16:07:33.753384 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: User-Agent: python-novaclient Sep 04 16:07:33.753384 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Auth-Token: gAAAAABjFM1FH_8UhHxnsBD8xVDPAv0jCpMFPpIt7pXmypkzpLfsUbFSNU1_7u0_R9a8EaOnDMSAoWZsIlwMJ269RD0xSOBZM2Lr3lVSuSBbyF0x5Bfqm07qblGSLi-h76NERu9QylUQ0f5nXGmo_ajJaRpLlxRmO8o-QlQUwOtM-HqFKTFovJ8 Sep 04 16:07:33.753384 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Domain-Id: None Sep 04 16:07:33.753384 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Domain-Name: None Sep 04 16:07:33.753384 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Identity-Status: Confirmed Sep 04 16:07:33.753384 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Is-Admin-Project: True Sep 04 16:07:33.753384 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Openstack-Nova-Api-Version: 2.92 Sep 04 16:07:33.753384 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Project-Domain-Id: default Sep 04 16:07:33.753384 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Project-Domain-Name: Default Sep 04 16:07:33.753384 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Project-Id: 677669b803a2416fad6430932644a341 Sep 04 16:07:33.753384 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Project-Name: admin Sep 04 16:07:33.753384 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Role: reader,member,admin Sep 04 16:07:33.753384 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Roles: reader,member,admin Sep 04 16:07:33.755025 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/677669b803a2416fad6430932644a341"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/677669b803a2416fad6430932644a341"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_677669b803a2416fad6430932644a341", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/677669b803a2416fad6430932644a341"}]}] Sep 04 16:07:33.755025 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Tenant: admin Sep 04 16:07:33.755025 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Tenant-Id: 677669b803a2416fad6430932644a341 Sep 04 16:07:33.755025 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Tenant-Name: admin Sep 04 16:07:33.755025 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-User: admin Sep 04 16:07:33.755025 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-User-Domain-Id: default Sep 04 16:07:33.755025 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-User-Domain-Name: Default Sep 04 16:07:33.755025 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-User-Id: f100ee5a590a4764a1d39fd503354ae4 Sep 04 16:07:33.755025 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-User-Name: admin Sep 04 16:07:33.755025 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: method: > Sep 04 16:07:33.755025 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: exception: Flavor 42 could not be found. Sep 04 16:07:33.755025 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: action_args: {'id': '42'} Sep 04 16:07:33.755025 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:07:33.755025 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:07:33.756026 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 04 16:07:33.756026 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 04 16:07:33.756026 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 04 16:07:33.756026 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 04 16:07:33.756026 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 04 16:07:33.756026 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 04 16:07:33.756026 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 04 16:07:33.756026 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 04 16:07:33.756026 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 04 16:07:33.756026 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:07:33.756026 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 04 16:07:33.756026 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 04 16:07:33.756026 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 04 16:07:33.756026 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi Sep 04 16:07:33.756026 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:07:33.756026 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi Sep 04 16:07:33.756026 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:07:33.756026 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:07:33.756026 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:07:33.757737 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:07:33.757737 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:07:33.757737 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:07:33.757737 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:07:33.757737 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 04 16:07:33.757737 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:07:33.757737 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 04 16:07:33.757737 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi Sep 04 16:07:33.757737 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:07:33.757737 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi Sep 04 16:07:33.757737 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:07:33.757737 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:07:33.757737 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:07:33.757737 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:07:33.757737 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:07:33.757737 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 04 16:07:33.757737 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi Sep 04 16:07:33.757737 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-7476ac3a-e273-4363-a8f3-39c707b658d9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:07:33.759022 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-7476ac3a-e273-4363-a8f3-39c707b658d9 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.395371 Sep 04 16:07:33.759022 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 19/39] 10.222.0.39 () {60 vars in 1190 bytes} [Sun Sep 4 16:07:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 04 16:07:33.764682 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-cb258e4c-548f-4c27-9ceb-f2ae63bd3096 admin admin] Calling method '>' {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:33.769846 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG dbcounter [-] [106058] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:07:33.790565 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-cb258e4c-548f-4c27-9ceb-f2ae63bd3096 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.029401 Sep 04 16:07:33.791108 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 21/40] 10.222.0.39 () {60 vars in 1210 bytes} [Sun Sep 4 16:07:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:07:33.801058 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-bee15f33-531a-4f3f-9712-7c906e929d9e admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:33.823928 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-bee15f33-531a-4f3f-9712-7c906e929d9e admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026460 Sep 04 16:07:33.824456 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 20/41] 10.222.0.39 () {60 vars in 1210 bytes} [Sun Sep 4 16:07:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:07:33.834668 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-6ba83229-7bc7-4abf-b44b-a23dd36e2976 admin admin] Calling method '>' {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:33.840366 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.wsgi [None req-6ba83229-7bc7-4abf-b44b-a23dd36e2976 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 04 16:07:33.843608 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-6ba83229-7bc7-4abf-b44b-a23dd36e2976 admin admin] Request method failure captured: Sep 04 16:07:33.843608 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 04 16:07:33.843608 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: Accept: application/json Sep 04 16:07:33.843608 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: Accept-Encoding: gzip, deflate Sep 04 16:07:33.843608 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: Connection: keep-alive Sep 04 16:07:33.843608 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: Content-Length: 0 Sep 04 16:07:33.843608 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: Host: 10.222.0.39 Sep 04 16:07:33.843608 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: Openstack-Api-Version: compute 2.92 Sep 04 16:07:33.843608 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: Openstack-System-Scope: None Sep 04 16:07:33.843608 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: User-Agent: python-novaclient Sep 04 16:07:33.843608 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Auth-Token: gAAAAABjFM1FH_8UhHxnsBD8xVDPAv0jCpMFPpIt7pXmypkzpLfsUbFSNU1_7u0_R9a8EaOnDMSAoWZsIlwMJ269RD0xSOBZM2Lr3lVSuSBbyF0x5Bfqm07qblGSLi-h76NERu9QylUQ0f5nXGmo_ajJaRpLlxRmO8o-QlQUwOtM-HqFKTFovJ8 Sep 04 16:07:33.843608 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Domain-Id: None Sep 04 16:07:33.843608 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Domain-Name: None Sep 04 16:07:33.843608 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Identity-Status: Confirmed Sep 04 16:07:33.843608 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Is-Admin-Project: True Sep 04 16:07:33.843608 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Openstack-Nova-Api-Version: 2.92 Sep 04 16:07:33.843608 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Project-Domain-Id: default Sep 04 16:07:33.843608 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Project-Domain-Name: Default Sep 04 16:07:33.843608 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Project-Id: 677669b803a2416fad6430932644a341 Sep 04 16:07:33.843608 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Project-Name: admin Sep 04 16:07:33.843608 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Role: reader,member,admin Sep 04 16:07:33.843608 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Roles: reader,member,admin Sep 04 16:07:33.845457 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/677669b803a2416fad6430932644a341"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/677669b803a2416fad6430932644a341"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_677669b803a2416fad6430932644a341", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/677669b803a2416fad6430932644a341"}]}] Sep 04 16:07:33.845457 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Tenant: admin Sep 04 16:07:33.845457 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Tenant-Id: 677669b803a2416fad6430932644a341 Sep 04 16:07:33.845457 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Tenant-Name: admin Sep 04 16:07:33.845457 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-User: admin Sep 04 16:07:33.845457 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-User-Domain-Id: default Sep 04 16:07:33.845457 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-User-Domain-Name: Default Sep 04 16:07:33.845457 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-User-Id: f100ee5a590a4764a1d39fd503354ae4 Sep 04 16:07:33.845457 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-User-Name: admin Sep 04 16:07:33.845457 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: method: > Sep 04 16:07:33.845457 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: exception: Flavor 42 could not be found. Sep 04 16:07:33.845457 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: action_args: {'id': '42'} Sep 04 16:07:33.845457 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:07:33.845457 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:07:33.851645 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 04 16:07:33.851645 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 04 16:07:33.851645 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 04 16:07:33.851645 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 04 16:07:33.851645 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 04 16:07:33.851645 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 04 16:07:33.851645 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 04 16:07:33.851645 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 04 16:07:33.851645 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 04 16:07:33.851645 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:07:33.851645 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 04 16:07:33.851645 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 04 16:07:33.851645 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 04 16:07:33.851645 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi Sep 04 16:07:33.851645 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:07:33.851645 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi Sep 04 16:07:33.851645 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:07:33.851645 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:07:33.851645 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:07:33.852989 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:07:33.852989 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:07:33.852989 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:07:33.852989 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:07:33.852989 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 04 16:07:33.852989 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:07:33.852989 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 04 16:07:33.852989 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi Sep 04 16:07:33.852989 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:07:33.852989 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi Sep 04 16:07:33.852989 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:07:33.852989 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:07:33.852989 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:07:33.852989 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:07:33.852989 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:07:33.852989 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 04 16:07:33.852989 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi Sep 04 16:07:33.852989 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-6ba83229-7bc7-4abf-b44b-a23dd36e2976 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:07:33.854218 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-6ba83229-7bc7-4abf-b44b-a23dd36e2976 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014170 Sep 04 16:07:33.854218 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 22/42] 10.222.0.39 () {60 vars in 1190 bytes} [Sun Sep 4 16:07:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 04 16:07:34.816411 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-bee15f33-531a-4f3f-9712-7c906e929d9e admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:34.817439 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-bee15f33-531a-4f3f-9712-7c906e929d9e admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 04 16:07:34.817890 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 21/43] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Sep 4 16:07:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:07:35.338006 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-62a132fd-92cc-4b49-a4c7-a20fba828aea admin admin] Calling method '>' {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:35.343311 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.wsgi [None req-62a132fd-92cc-4b49-a4c7-a20fba828aea admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 04 16:07:35.344793 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-62a132fd-92cc-4b49-a4c7-a20fba828aea admin admin] Request method failure captured: Sep 04 16:07:35.344793 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 04 16:07:35.344793 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: Accept: application/json Sep 04 16:07:35.344793 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: Accept-Encoding: gzip, deflate Sep 04 16:07:35.344793 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: Connection: keep-alive Sep 04 16:07:35.344793 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: Content-Length: 0 Sep 04 16:07:35.344793 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: Host: 10.222.0.39 Sep 04 16:07:35.344793 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: Openstack-Api-Version: compute 2.92 Sep 04 16:07:35.344793 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: Openstack-System-Scope: None Sep 04 16:07:35.344793 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: User-Agent: python-novaclient Sep 04 16:07:35.344793 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Auth-Token: gAAAAABjFM1Gtz3Lnvc7GSyaK9bQlBLkDqAL-XCV5olvo9OdCRgmXonb7G8mkGNEGR9lida8a4UfcPlZ5spYs8k1tDnXjqHi3gA-eLEBZ7hz0WMHJqcpFCpVI02Pvzhm-Bi557wGjIDCuQrY_1JGP85V2epijvc_pB8QLWKyZ1CX5czxkSUEZeo Sep 04 16:07:35.344793 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Domain-Id: None Sep 04 16:07:35.344793 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Domain-Name: None Sep 04 16:07:35.344793 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Identity-Status: Confirmed Sep 04 16:07:35.344793 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Is-Admin-Project: True Sep 04 16:07:35.344793 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Openstack-Nova-Api-Version: 2.92 Sep 04 16:07:35.344793 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Project-Domain-Id: default Sep 04 16:07:35.344793 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Project-Domain-Name: Default Sep 04 16:07:35.344793 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Project-Id: 677669b803a2416fad6430932644a341 Sep 04 16:07:35.344793 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Project-Name: admin Sep 04 16:07:35.344793 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Role: reader,member,admin Sep 04 16:07:35.344793 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Roles: reader,member,admin Sep 04 16:07:35.347001 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/677669b803a2416fad6430932644a341"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/677669b803a2416fad6430932644a341"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_677669b803a2416fad6430932644a341", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/677669b803a2416fad6430932644a341"}]}] Sep 04 16:07:35.347001 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Tenant: admin Sep 04 16:07:35.347001 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Tenant-Id: 677669b803a2416fad6430932644a341 Sep 04 16:07:35.347001 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Tenant-Name: admin Sep 04 16:07:35.347001 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-User: admin Sep 04 16:07:35.347001 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-User-Domain-Id: default Sep 04 16:07:35.347001 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-User-Domain-Name: Default Sep 04 16:07:35.347001 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-User-Id: f100ee5a590a4764a1d39fd503354ae4 Sep 04 16:07:35.347001 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-User-Name: admin Sep 04 16:07:35.347001 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: method: > Sep 04 16:07:35.347001 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: exception: Flavor 84 could not be found. Sep 04 16:07:35.347001 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: action_args: {'id': '84'} Sep 04 16:07:35.347001 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:07:35.347001 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:07:35.348022 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 04 16:07:35.348022 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 04 16:07:35.348022 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 04 16:07:35.348022 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 04 16:07:35.348022 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 04 16:07:35.348022 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 04 16:07:35.348022 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 04 16:07:35.348022 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 04 16:07:35.348022 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 04 16:07:35.348022 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:07:35.348022 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 04 16:07:35.348022 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 04 16:07:35.348022 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 04 16:07:35.348022 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi Sep 04 16:07:35.348022 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:07:35.348022 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi Sep 04 16:07:35.348022 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:07:35.348022 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:07:35.348022 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:07:35.349316 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:07:35.349316 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:07:35.349316 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:07:35.349316 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:07:35.349316 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 04 16:07:35.349316 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:07:35.349316 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 04 16:07:35.349316 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi Sep 04 16:07:35.349316 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:07:35.349316 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi Sep 04 16:07:35.349316 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:07:35.349316 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:07:35.349316 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:07:35.349316 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:07:35.349316 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:07:35.349316 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 04 16:07:35.349316 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi Sep 04 16:07:35.349316 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-62a132fd-92cc-4b49-a4c7-a20fba828aea admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:07:35.350589 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-62a132fd-92cc-4b49-a4c7-a20fba828aea admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.393064 Sep 04 16:07:35.350589 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 23/44] 10.222.0.39 () {60 vars in 1190 bytes} [Sun Sep 4 16:07:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 04 16:07:35.356340 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-8131022f-060e-47de-a152-196cbf6a81e7 admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:35.371851 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-8131022f-060e-47de-a152-196cbf6a81e7 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019019 Sep 04 16:07:35.372368 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 22/45] 10.222.0.39 () {60 vars in 1210 bytes} [Sun Sep 4 16:07:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:07:35.382713 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-c8a98e28-8bc6-4ec5-b8fd-3a91bcd50b47 admin admin] Calling method '>' {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:35.398538 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-c8a98e28-8bc6-4ec5-b8fd-3a91bcd50b47 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019508 Sep 04 16:07:35.399068 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 24/46] 10.222.0.39 () {60 vars in 1210 bytes} [Sun Sep 4 16:07:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:07:35.408523 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-749b58b2-98d4-49a5-9e53-d6ee12f17b4e admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:35.413855 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.wsgi [None req-749b58b2-98d4-49a5-9e53-d6ee12f17b4e admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 04 16:07:35.415335 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-749b58b2-98d4-49a5-9e53-d6ee12f17b4e admin admin] Request method failure captured: Sep 04 16:07:35.415335 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 04 16:07:35.415335 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: Accept: application/json Sep 04 16:07:35.415335 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: Accept-Encoding: gzip, deflate Sep 04 16:07:35.415335 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: Connection: keep-alive Sep 04 16:07:35.415335 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: Content-Length: 0 Sep 04 16:07:35.415335 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: Host: 10.222.0.39 Sep 04 16:07:35.415335 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: Openstack-Api-Version: compute 2.92 Sep 04 16:07:35.415335 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: Openstack-System-Scope: None Sep 04 16:07:35.415335 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: User-Agent: python-novaclient Sep 04 16:07:35.415335 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Auth-Token: gAAAAABjFM1Gtz3Lnvc7GSyaK9bQlBLkDqAL-XCV5olvo9OdCRgmXonb7G8mkGNEGR9lida8a4UfcPlZ5spYs8k1tDnXjqHi3gA-eLEBZ7hz0WMHJqcpFCpVI02Pvzhm-Bi557wGjIDCuQrY_1JGP85V2epijvc_pB8QLWKyZ1CX5czxkSUEZeo Sep 04 16:07:35.415335 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Domain-Id: None Sep 04 16:07:35.415335 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Domain-Name: None Sep 04 16:07:35.415335 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Identity-Status: Confirmed Sep 04 16:07:35.415335 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Is-Admin-Project: True Sep 04 16:07:35.415335 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Openstack-Nova-Api-Version: 2.92 Sep 04 16:07:35.415335 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Project-Domain-Id: default Sep 04 16:07:35.415335 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Project-Domain-Name: Default Sep 04 16:07:35.415335 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Project-Id: 677669b803a2416fad6430932644a341 Sep 04 16:07:35.415335 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Project-Name: admin Sep 04 16:07:35.415335 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Role: reader,member,admin Sep 04 16:07:35.415335 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Roles: reader,member,admin Sep 04 16:07:35.416817 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/677669b803a2416fad6430932644a341"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/677669b803a2416fad6430932644a341"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_677669b803a2416fad6430932644a341", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/677669b803a2416fad6430932644a341"}]}] Sep 04 16:07:35.416817 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Tenant: admin Sep 04 16:07:35.416817 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Tenant-Id: 677669b803a2416fad6430932644a341 Sep 04 16:07:35.416817 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Tenant-Name: admin Sep 04 16:07:35.416817 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-User: admin Sep 04 16:07:35.416817 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-User-Domain-Id: default Sep 04 16:07:35.416817 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-User-Domain-Name: Default Sep 04 16:07:35.416817 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-User-Id: f100ee5a590a4764a1d39fd503354ae4 Sep 04 16:07:35.416817 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-User-Name: admin Sep 04 16:07:35.416817 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: method: > Sep 04 16:07:35.416817 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: exception: Flavor 84 could not be found. Sep 04 16:07:35.416817 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: action_args: {'id': '84'} Sep 04 16:07:35.416817 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:07:35.416817 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:07:35.417771 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 04 16:07:35.417771 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 04 16:07:35.417771 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 04 16:07:35.417771 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 04 16:07:35.417771 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 04 16:07:35.417771 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 04 16:07:35.417771 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 04 16:07:35.417771 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 04 16:07:35.417771 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 04 16:07:35.417771 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:07:35.417771 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 04 16:07:35.417771 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 04 16:07:35.417771 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 04 16:07:35.417771 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi Sep 04 16:07:35.417771 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:07:35.417771 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi Sep 04 16:07:35.417771 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:07:35.417771 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:07:35.417771 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:07:35.419068 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:07:35.419068 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:07:35.419068 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:07:35.419068 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:07:35.419068 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 04 16:07:35.419068 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:07:35.419068 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 04 16:07:35.419068 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi Sep 04 16:07:35.419068 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:07:35.419068 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi Sep 04 16:07:35.419068 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:07:35.419068 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:07:35.419068 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:07:35.419068 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:07:35.419068 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:07:35.419068 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 04 16:07:35.419068 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi Sep 04 16:07:35.419068 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-749b58b2-98d4-49a5-9e53-d6ee12f17b4e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:07:35.420250 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-749b58b2-98d4-49a5-9e53-d6ee12f17b4e admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011839 Sep 04 16:07:35.420250 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 23/47] 10.222.0.39 () {60 vars in 1190 bytes} [Sun Sep 4 16:07:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 04 16:07:36.383916 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-c8a98e28-8bc6-4ec5-b8fd-3a91bcd50b47 admin admin] Calling method '>' {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:36.384913 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-c8a98e28-8bc6-4ec5-b8fd-3a91bcd50b47 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Sep 04 16:07:36.385332 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 25/48] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Sep 4 16:07:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:07:36.907485 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-24ec74c9-6009-41d8-a8d8-f6fab554bb14 admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:36.913452 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.wsgi [None req-24ec74c9-6009-41d8-a8d8-f6fab554bb14 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 04 16:07:36.914973 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-24ec74c9-6009-41d8-a8d8-f6fab554bb14 admin admin] Request method failure captured: Sep 04 16:07:36.914973 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 04 16:07:36.914973 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: Accept: application/json Sep 04 16:07:36.914973 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: Accept-Encoding: gzip, deflate Sep 04 16:07:36.914973 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: Connection: keep-alive Sep 04 16:07:36.914973 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: Content-Length: 0 Sep 04 16:07:36.914973 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: Host: 10.222.0.39 Sep 04 16:07:36.914973 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: Openstack-Api-Version: compute 2.92 Sep 04 16:07:36.914973 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: Openstack-System-Scope: None Sep 04 16:07:36.914973 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: User-Agent: python-novaclient Sep 04 16:07:36.914973 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Auth-Token: gAAAAABjFM1ISyWz8I6OQa5hFygZ82WKxrxFqEnOkN4RELfpLzXTD6Ms_IZJZJa92woYHoCHkL78HbA6NbtqtJhPVZr4x8WfgNlR6FcTSn2zzmcCY4VJHVAPbPmKEInbvutrJbJImwRNMKN8kFx8S_ou198kkJ29QTVuFP2gDUltmAZLbk_sfPI Sep 04 16:07:36.914973 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Domain-Id: None Sep 04 16:07:36.914973 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Domain-Name: None Sep 04 16:07:36.914973 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Identity-Status: Confirmed Sep 04 16:07:36.914973 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Is-Admin-Project: True Sep 04 16:07:36.914973 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Openstack-Nova-Api-Version: 2.92 Sep 04 16:07:36.914973 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Project-Domain-Id: default Sep 04 16:07:36.914973 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Project-Domain-Name: Default Sep 04 16:07:36.914973 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Project-Id: 677669b803a2416fad6430932644a341 Sep 04 16:07:36.914973 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Project-Name: admin Sep 04 16:07:36.914973 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Role: reader,member,admin Sep 04 16:07:36.914973 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Roles: reader,member,admin Sep 04 16:07:36.916533 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/677669b803a2416fad6430932644a341"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/677669b803a2416fad6430932644a341"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_677669b803a2416fad6430932644a341", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/677669b803a2416fad6430932644a341"}]}] Sep 04 16:07:36.916533 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Tenant: admin Sep 04 16:07:36.916533 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Tenant-Id: 677669b803a2416fad6430932644a341 Sep 04 16:07:36.916533 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-Tenant-Name: admin Sep 04 16:07:36.916533 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-User: admin Sep 04 16:07:36.916533 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-User-Domain-Id: default Sep 04 16:07:36.916533 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-User-Domain-Name: Default Sep 04 16:07:36.916533 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-User-Id: f100ee5a590a4764a1d39fd503354ae4 Sep 04 16:07:36.916533 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: X-User-Name: admin Sep 04 16:07:36.916533 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: method: > Sep 04 16:07:36.916533 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: exception: Flavor 451 could not be found. Sep 04 16:07:36.916533 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: action_args: {'id': '451'} Sep 04 16:07:36.916533 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:07:36.916533 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:07:36.917502 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 04 16:07:36.917502 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 04 16:07:36.917502 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 04 16:07:36.917502 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 04 16:07:36.917502 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 04 16:07:36.917502 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 04 16:07:36.917502 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 04 16:07:36.917502 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 04 16:07:36.917502 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 04 16:07:36.917502 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:07:36.917502 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 04 16:07:36.917502 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 04 16:07:36.917502 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 04 16:07:36.917502 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi Sep 04 16:07:36.917502 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:07:36.917502 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi Sep 04 16:07:36.917502 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:07:36.917502 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:07:36.917502 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:07:36.918732 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:07:36.918732 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:07:36.918732 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:07:36.918732 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:07:36.918732 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 04 16:07:36.918732 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:07:36.918732 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 04 16:07:36.918732 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi Sep 04 16:07:36.918732 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:07:36.918732 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi Sep 04 16:07:36.918732 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:07:36.918732 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:07:36.918732 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:07:36.918732 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:07:36.918732 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:07:36.918732 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 04 16:07:36.918732 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: ERROR nova.api.openstack.wsgi Sep 04 16:07:36.918732 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-24ec74c9-6009-41d8-a8d8-f6fab554bb14 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106059) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:07:36.919958 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-24ec74c9-6009-41d8-a8d8-f6fab554bb14 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.392385 Sep 04 16:07:36.919958 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 24/49] 10.222.0.39 () {60 vars in 1193 bytes} [Sun Sep 4 16:07:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 04 16:07:36.928882 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-3fc72eef-834c-4840-9066-c6bd7ff10ff9 admin admin] Calling method '>' {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:36.944505 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-3fc72eef-834c-4840-9066-c6bd7ff10ff9 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019790 Sep 04 16:07:36.945043 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 26/50] 10.222.0.39 () {60 vars in 1210 bytes} [Sun Sep 4 16:07:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:07:36.955484 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-beddffad-0e78-4248-8609-868ee5ce32df admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:36.970681 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-beddffad-0e78-4248-8609-868ee5ce32df admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019503 Sep 04 16:07:36.971237 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 25/51] 10.222.0.39 () {60 vars in 1210 bytes} [Sun Sep 4 16:07:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:07:36.980507 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-b45a7b77-ba62-4444-b26a-bb6e1f361b6c admin admin] Calling method '>' {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:36.985840 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.wsgi [None req-b45a7b77-ba62-4444-b26a-bb6e1f361b6c admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 04 16:07:36.987320 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-b45a7b77-ba62-4444-b26a-bb6e1f361b6c admin admin] Request method failure captured: Sep 04 16:07:36.987320 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 04 16:07:36.987320 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: Accept: application/json Sep 04 16:07:36.987320 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: Accept-Encoding: gzip, deflate Sep 04 16:07:36.987320 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: Connection: keep-alive Sep 04 16:07:36.987320 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: Content-Length: 0 Sep 04 16:07:36.987320 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: Host: 10.222.0.39 Sep 04 16:07:36.987320 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: Openstack-Api-Version: compute 2.92 Sep 04 16:07:36.987320 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: Openstack-System-Scope: None Sep 04 16:07:36.987320 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: User-Agent: python-novaclient Sep 04 16:07:36.987320 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Auth-Token: gAAAAABjFM1ISyWz8I6OQa5hFygZ82WKxrxFqEnOkN4RELfpLzXTD6Ms_IZJZJa92woYHoCHkL78HbA6NbtqtJhPVZr4x8WfgNlR6FcTSn2zzmcCY4VJHVAPbPmKEInbvutrJbJImwRNMKN8kFx8S_ou198kkJ29QTVuFP2gDUltmAZLbk_sfPI Sep 04 16:07:36.987320 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Domain-Id: None Sep 04 16:07:36.987320 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Domain-Name: None Sep 04 16:07:36.987320 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Identity-Status: Confirmed Sep 04 16:07:36.987320 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Is-Admin-Project: True Sep 04 16:07:36.987320 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Openstack-Nova-Api-Version: 2.92 Sep 04 16:07:36.987320 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Project-Domain-Id: default Sep 04 16:07:36.987320 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Project-Domain-Name: Default Sep 04 16:07:36.987320 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Project-Id: 677669b803a2416fad6430932644a341 Sep 04 16:07:36.987320 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Project-Name: admin Sep 04 16:07:36.987320 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Role: reader,member,admin Sep 04 16:07:36.987320 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Roles: reader,member,admin Sep 04 16:07:36.988805 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/677669b803a2416fad6430932644a341"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/677669b803a2416fad6430932644a341"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_677669b803a2416fad6430932644a341", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/677669b803a2416fad6430932644a341"}]}] Sep 04 16:07:36.988805 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Tenant: admin Sep 04 16:07:36.988805 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Tenant-Id: 677669b803a2416fad6430932644a341 Sep 04 16:07:36.988805 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-Tenant-Name: admin Sep 04 16:07:36.988805 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-User: admin Sep 04 16:07:36.988805 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-User-Domain-Id: default Sep 04 16:07:36.988805 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-User-Domain-Name: Default Sep 04 16:07:36.988805 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-User-Id: f100ee5a590a4764a1d39fd503354ae4 Sep 04 16:07:36.988805 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: X-User-Name: admin Sep 04 16:07:36.988805 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: method: > Sep 04 16:07:36.988805 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: exception: Flavor 451 could not be found. Sep 04 16:07:36.988805 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: action_args: {'id': '451'} Sep 04 16:07:36.988805 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:07:36.988805 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:07:36.989643 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 04 16:07:36.989643 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 04 16:07:36.989643 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 04 16:07:36.989643 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 04 16:07:36.989643 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 04 16:07:36.989643 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 04 16:07:36.989643 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 04 16:07:36.989643 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 04 16:07:36.989643 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 04 16:07:36.989643 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:07:36.989643 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 04 16:07:36.989643 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 04 16:07:36.989643 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 04 16:07:36.989643 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi Sep 04 16:07:36.989643 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:07:36.989643 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi Sep 04 16:07:36.989643 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:07:36.989643 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:07:36.989643 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:07:36.990729 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:07:36.990729 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:07:36.990729 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:07:36.990729 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:07:36.990729 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 04 16:07:36.990729 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:07:36.990729 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 04 16:07:36.990729 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi Sep 04 16:07:36.990729 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:07:36.990729 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi Sep 04 16:07:36.990729 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:07:36.990729 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:07:36.990729 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:07:36.990729 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:07:36.990729 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:07:36.990729 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 04 16:07:36.990729 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: ERROR nova.api.openstack.wsgi Sep 04 16:07:36.990729 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-b45a7b77-ba62-4444-b26a-bb6e1f361b6c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:07:36.991787 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-b45a7b77-ba62-4444-b26a-bb6e1f361b6c admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011723 Sep 04 16:07:36.991787 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 27/52] 10.222.0.39 () {60 vars in 1193 bytes} [Sun Sep 4 16:07:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 04 16:07:37.955970 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-beddffad-0e78-4248-8609-868ee5ce32df admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:37.957109 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-beddffad-0e78-4248-8609-868ee5ce32df admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001901 Sep 04 16:07:37.957498 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 26/53] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Sep 4 16:07:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:07:38.483046 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-49c05731-b386-464a-b9dc-2db1058dfc87 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:07:38.571479 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-49c05731-b386-464a-b9dc-2db1058dfc87 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.473387 Sep 04 16:07:38.572019 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 28/54] 10.222.0.39 () {64 vars in 1235 bytes} [Sun Sep 4 16:07:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:07:39.547157 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-beddffad-0e78-4248-8609-868ee5ce32df admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:39.548270 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-beddffad-0e78-4248-8609-868ee5ce32df admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Sep 04 16:07:39.548666 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 27/55] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Sep 4 16:07:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:07:40.069910 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-62f57331-5a1d-4812-888d-f00c60b4f9a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:07:40.137387 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-62f57331-5a1d-4812-888d-f00c60b4f9a3 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.451174 Sep 04 16:07:40.137973 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 29/56] 10.222.0.39 () {64 vars in 1235 bytes} [Sun Sep 4 16:07:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:07:41.106814 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-beddffad-0e78-4248-8609-868ee5ce32df admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:41.107822 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-beddffad-0e78-4248-8609-868ee5ce32df admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 04 16:07:41.108221 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 28/57] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Sep 4 16:07:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:07:41.633116 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-7b013143-51b1-42f6-9ee2-d9cdd11b71be admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:07:41.715644 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-7b013143-51b1-42f6-9ee2-d9cdd11b71be admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.468173 Sep 04 16:07:41.716181 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 30/58] 10.222.0.39 () {64 vars in 1235 bytes} [Sun Sep 4 16:07:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:07:42.688074 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-beddffad-0e78-4248-8609-868ee5ce32df admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:42.689964 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-beddffad-0e78-4248-8609-868ee5ce32df admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002240 Sep 04 16:07:42.690357 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 29/59] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Sep 4 16:07:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:07:43.213068 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-1784c11a-726a-43d0-a0a7-006f29b311b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:07:43.291531 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-1784c11a-726a-43d0-a0a7-006f29b311b2 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.463463 Sep 04 16:07:43.292075 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 31/60] 10.222.0.39 () {64 vars in 1235 bytes} [Sun Sep 4 16:07:42 2022] POST /compute/v2.1/flavors => generated 409 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:07:44.272107 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-beddffad-0e78-4248-8609-868ee5ce32df admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:44.273147 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-beddffad-0e78-4248-8609-868ee5ce32df admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 04 16:07:44.273541 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 30/61] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Sep 4 16:07:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:07:44.805874 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-3334af8e-07eb-49cb-970e-1da911376a28 admin admin] Calling method '>' {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:07:44.826866 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-3334af8e-07eb-49cb-970e-1da911376a28 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.416335 Sep 04 16:07:44.827399 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 32/62] 10.222.0.39 () {60 vars in 1202 bytes} [Sun Sep 4 16:07:44 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:08:38.495397 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-beddffad-0e78-4248-8609-868ee5ce32df admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:08:38.496360 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-beddffad-0e78-4248-8609-868ee5ce32df admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Sep 04 16:08:38.496759 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 31/63] 10.222.0.39 () {54 vars in 931 bytes} [Sun Sep 4 16:08:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:08:38.508401 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG dbcounter [-] [106058] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:08:38.898162 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-7f3d9163-5e1c-4688-b6cc-a04914cd9dd0 admin admin] Calling method '>' {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:08:38.920119 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-7f3d9163-5e1c-4688-b6cc-a04914cd9dd0 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.416462 Sep 04 16:08:38.920660 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 33/64] 10.222.0.39 () {60 vars in 1292 bytes} [Sun Sep 4 16:08:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:08:38.942465 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG dbcounter [-] [106059] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106059) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:08:38.946203 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-46659831-73c6-4a8f-9fb7-8cef405f2c95 admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:08:38.954440 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-46659831-73c6-4a8f-9fb7-8cef405f2c95 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013554 Sep 04 16:08:38.955158 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 32/65] 10.222.0.39 () {60 vars in 1283 bytes} [Sun Sep 4 16:08:38 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:08:38.966726 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-3f6fbcd4-ea39-4d27-8f99-d964682a41cb admin admin] Calling method '>' {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:08:38.974727 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-3f6fbcd4-ea39-4d27-8f99-d964682a41cb admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011619 Sep 04 16:08:38.975264 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 34/66] 10.222.0.39 () {60 vars in 1286 bytes} [Sun Sep 4 16:08:38 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:08:38.986943 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-c858a2b5-6c9b-42f8-85c5-71d44890dd53 admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:08:38.994948 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-c858a2b5-6c9b-42f8-85c5-71d44890dd53 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011639 Sep 04 16:08:38.995469 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 33/67] 10.222.0.39 () {60 vars in 1286 bytes} [Sun Sep 4 16:08:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:08:39.008213 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-e91931e9-0b1b-4c3e-ba65-3c048d6dbc70 admin admin] Calling method '>' {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:08:39.016871 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-e91931e9-0b1b-4c3e-ba65-3c048d6dbc70 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012549 Sep 04 16:08:39.017386 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 35/68] 10.222.0.39 () {60 vars in 1283 bytes} [Sun Sep 4 16:08:39 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:11:40.716171 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-c858a2b5-6c9b-42f8-85c5-71d44890dd53 admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:11:40.721600 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-c858a2b5-6c9b-42f8-85c5-71d44890dd53 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Sep 04 16:11:40.721600 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 34/69] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Sep 4 16:11:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:11:40.864299 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG dbcounter [-] [106058] Writing DB stats nova_api:SELECT=6 {{(pid=106058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:11:41.028762 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-d180ff8d-d458-4e39-9aa6-8eee6e1f2a60 admin admin] Calling method '>' {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:11:41.032422 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-d180ff8d-d458-4e39-9aa6-8eee6e1f2a60 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:11:41.032896 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-d180ff8d-d458-4e39-9aa6-8eee6e1f2a60 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:11:41.033384 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-d180ff8d-d458-4e39-9aa6-8eee6e1f2a60 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:11:41.034084 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-d180ff8d-d458-4e39-9aa6-8eee6e1f2a60 admin admin] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:11:41.040106 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-d180ff8d-d458-4e39-9aa6-8eee6e1f2a60 admin admin] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:11:41.040106 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-d180ff8d-d458-4e39-9aa6-8eee6e1f2a60 admin admin] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:11:41.070448 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-d180ff8d-d458-4e39-9aa6-8eee6e1f2a60 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.207494 Sep 04 16:11:41.071010 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 36/70] 10.222.0.39 () {60 vars in 1193 bytes} [Sun Sep 4 16:11:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:11:41.898171 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-c858a2b5-6c9b-42f8-85c5-71d44890dd53 admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:11:41.899316 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-c858a2b5-6c9b-42f8-85c5-71d44890dd53 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001714 Sep 04 16:11:41.899740 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 35/71] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Sep 4 16:11:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:11:42.112069 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-66098e86-2473-4bab-b9df-4ad36aca686e admin admin] Calling method '>' {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:11:42.115456 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-66098e86-2473-4bab-b9df-4ad36aca686e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:11:42.115927 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-66098e86-2473-4bab-b9df-4ad36aca686e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:11:42.116348 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-66098e86-2473-4bab-b9df-4ad36aca686e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:11:42.117080 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-66098e86-2473-4bab-b9df-4ad36aca686e admin admin] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:11:42.117520 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-66098e86-2473-4bab-b9df-4ad36aca686e admin admin] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:11:42.117952 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-66098e86-2473-4bab-b9df-4ad36aca686e admin admin] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:11:42.137966 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-66098e86-2473-4bab-b9df-4ad36aca686e admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.081578 Sep 04 16:11:42.138501 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 37/72] 10.222.0.39 () {60 vars in 1193 bytes} [Sun Sep 4 16:11:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:11:53.388007 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-c858a2b5-6c9b-42f8-85c5-71d44890dd53 admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:11:53.389030 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-c858a2b5-6c9b-42f8-85c5-71d44890dd53 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Sep 04 16:11:53.390018 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 36/73] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Sep 4 16:11:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:11:53.538264 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG dbcounter [-] [106058] Writing DB stats nova_cell0:SELECT=4 {{(pid=106058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:11:53.539197 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG dbcounter [-] [106058] Writing DB stats nova_cell1:SELECT=4 {{(pid=106058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:11:53.539626 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG dbcounter [-] [106058] Writing DB stats nova_api:SELECT=8 {{(pid=106058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:11:53.591609 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-64e8dd58-7b1c-451a-8ec1-095504a9a480 admin admin] Calling method '>' {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:11:53.595948 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-64e8dd58-7b1c-451a-8ec1-095504a9a480 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:11:53.599285 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-64e8dd58-7b1c-451a-8ec1-095504a9a480 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:11:53.599285 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-64e8dd58-7b1c-451a-8ec1-095504a9a480 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:11:53.599285 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-64e8dd58-7b1c-451a-8ec1-095504a9a480 admin admin] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:11:53.599285 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-64e8dd58-7b1c-451a-8ec1-095504a9a480 admin admin] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:11:53.599680 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-64e8dd58-7b1c-451a-8ec1-095504a9a480 admin admin] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:11:53.624265 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-64e8dd58-7b1c-451a-8ec1-095504a9a480 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.090014 Sep 04 16:11:53.624909 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 38/74] 10.222.0.39 () {60 vars in 1193 bytes} [Sun Sep 4 16:11:53 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:11:54.448639 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: DEBUG nova.api.openstack.wsgi [None req-c858a2b5-6c9b-42f8-85c5-71d44890dd53 admin admin] Calling method '>' {{(pid=106059) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:11:54.449697 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: INFO nova.api.openstack.requestlog [None req-c858a2b5-6c9b-42f8-85c5-71d44890dd53 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 04 16:11:54.450130 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: [pid: 106059|app: 0|req: 37/75] 10.222.0.39 () {56 vars in 1074 bytes} [Sun Sep 4 16:11:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:11:54.655398 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG nova.api.openstack.wsgi [None req-0b97d3a0-09ce-48f2-a64a-a512d0ae1076 admin admin] Calling method '>' {{(pid=106058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:11:54.658836 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-0b97d3a0-09ce-48f2-a64a-a512d0ae1076 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:11:54.659305 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-0b97d3a0-09ce-48f2-a64a-a512d0ae1076 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:11:54.659725 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-0b97d3a0-09ce-48f2-a64a-a512d0ae1076 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:11:54.660458 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-0b97d3a0-09ce-48f2-a64a-a512d0ae1076 admin admin] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:11:54.660900 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-0b97d3a0-09ce-48f2-a64a-a512d0ae1076 admin admin] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:11:54.661311 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: DEBUG oslo_concurrency.lockutils [None req-0b97d3a0-09ce-48f2-a64a-a512d0ae1076 admin admin] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:11:54.683360 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: INFO nova.api.openstack.requestlog [None req-0b97d3a0-09ce-48f2-a64a-a512d0ae1076 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.080728 Sep 04 16:11:54.683897 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: [pid: 106058|app: 0|req: 39/76] 10.222.0.39 () {60 vars in 1193 bytes} [Sun Sep 4 16:11:54 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:12:50.081902 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: Sun Sep 4 16:12:50 2022 - graceful shutdown triggered... Sep 04 16:12:50.081646 dv-cinder-852364-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 04 16:12:50.082835 dv-cinder-852364-6-iscsi devstack@n-api.service[106058]: Gracefully killing worker 1 (pid: 106058)... Sep 04 16:12:50.083194 dv-cinder-852364-6-iscsi devstack@n-api.service[106059]: Gracefully killing worker 2 (pid: 106059)... Sep 04 16:12:51.082668 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: worker 1 buried after 1 seconds Sep 04 16:12:51.083203 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: worker 2 buried after 1 seconds Sep 04 16:12:51.083203 dv-cinder-852364-6-iscsi devstack@n-api.service[106057]: goodbye to uWSGI. Sep 04 16:12:51.084331 dv-cinder-852364-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 04 16:12:51.084923 dv-cinder-852364-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 04 16:12:51.087741 dv-cinder-852364-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 04 16:12:51.097178 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 04 16:12:51.099835 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 4 16:12:51 2022] *** Sep 04 16:12:51.099996 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 04 16:12:51.100124 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 04 16:12:51.100244 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: nodename: dv-cinder-852364-6-iscsi Sep 04 16:12:51.100355 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: machine: x86_64 Sep 04 16:12:51.100460 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: clock source: unix Sep 04 16:12:51.100556 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: pcre jit disabled Sep 04 16:12:51.100662 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: detected number of CPU cores: 4 Sep 04 16:12:51.100761 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: current working directory: / Sep 04 16:12:51.100888 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: detected binary path: /usr/bin/uwsgi-core Sep 04 16:12:51.100888 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: your processes number limit is 47680 Sep 04 16:12:51.100888 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: your memory page size is 4096 bytes Sep 04 16:12:51.100888 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: detected max file descriptor number: 2048 Sep 04 16:12:51.100888 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: lock engine: pthread robust mutexes Sep 04 16:12:51.101265 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: thunder lock: enabled Sep 04 16:12:51.101265 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 04 16:12:51.101409 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 04 16:12:51.140241 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: Python main interpreter initialized at 0x55ae9119e9c0 Sep 04 16:12:51.140241 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: python threads support enabled Sep 04 16:12:51.140241 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: your server socket listen backlog is limited to 100 connections Sep 04 16:12:51.140241 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: your mercy for graceful operations on workers is 90 seconds Sep 04 16:12:51.140599 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: mapped 403077 bytes (393 KB) for 2 cores Sep 04 16:12:51.140675 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: *** Operational MODE: preforking *** Sep 04 16:12:51.140943 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: *** uWSGI is running in multiple interpreter mode *** Sep 04 16:12:51.140943 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: spawned uWSGI master process (pid: 121026) Sep 04 16:12:51.146243 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: spawned uWSGI worker 1 (pid: 121040, cores: 1) Sep 04 16:12:51.146243 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: spawned uWSGI worker 2 (pid: 121041, cores: 1) Sep 04 16:12:51.146243 dv-cinder-852364-6-iscsi devstack@n-api.service[121026]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 04 16:12:51.141150 dv-cinder-852364-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 04 16:12:51.811033 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 04 16:12:51.819176 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 04 16:12:52.982992 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 04 16:12:52.982992 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: from cryptography.utils import int_from_bytes Sep 04 16:12:52.983631 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 04 16:12:52.983631 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: from cryptography.utils import int_from_bytes Sep 04 16:12:53.021943 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 04 16:12:53.021943 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: from cryptography.utils import int_from_bytes Sep 04 16:12:53.022506 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 04 16:12:53.022506 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: from cryptography.utils import int_from_bytes Sep 04 16:12:55.404258 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 04 16:12:55.404823 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 04 16:12:55.405048 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 04 16:12:55.405361 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 04 16:12:55.405657 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 04 16:12:55.406050 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.406378 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.407229 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.407558 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.407895 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.408207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.408532 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.408855 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.409185 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.409440 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.409787 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.410286 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852364-6-iscsi {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.410617 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.410930 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.411255 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.411573 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.411883 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.413649 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.413649 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.413649 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.415113 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.415113 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.415503 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.415818 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.416135 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.416456 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.416776 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.417092 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.417419 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.417771 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.418186 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852364-6-iscsi {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.418511 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.418827 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.419139 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.419576 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.419899 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.420228 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.420547 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.420879 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.421201 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.421542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.421891 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.422237 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.422642 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.422950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.423263 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.423679 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.424023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.424337 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.426794 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.426794 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.426794 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.426794 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.426794 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.426794 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.426794 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.427445 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.427445 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.427445 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.427652 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.428160 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.428665 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.429126 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.429607 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.430184 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.430671 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.431149 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.431734 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.432229 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.432716 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.433182 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.433692 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.434289 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.434695 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.435171 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.435688 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.436173 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.436641 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.437133 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.437653 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.438794 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.439401 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.439870 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.440377 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.440730 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.441053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.441313 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.441661 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.442161 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.442660 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.442979 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.443295 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.443609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.443918 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.444233 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.444546 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.444855 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.445165 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.445474 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.445813 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.446125 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.446438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.446748 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.447058 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.447393 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.447719 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.448030 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.448339 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.448647 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.448957 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.449281 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.449654 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.449933 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.450262 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.450573 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.450880 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.451204 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.451513 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.451822 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.452162 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.452456 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.452920 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.453422 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.453849 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.454161 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.454630 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.454943 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.455253 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.455561 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.455868 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.456179 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.456484 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.456812 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.457137 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.457449 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.457783 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.458094 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.458418 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.458763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.459100 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.459448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.459764 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.460099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.460435 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.460756 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.461231 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.461393 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.461739 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.462060 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.462383 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.462704 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.463027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.463341 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.463676 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.463996 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.464310 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.464630 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.464945 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.465267 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.465627 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.465958 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.466276 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.466624 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.466981 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.467301 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.467632 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.467975 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.468275 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.468593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.468905 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.469808 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.470131 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.470448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.470758 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.471075 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.471479 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.471719 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.472038 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.472356 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.472669 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.472988 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.473346 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.473700 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.474016 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.474337 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.474839 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.475160 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.475478 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.475793 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.476106 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.476418 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.476729 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.477039 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.477353 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.477686 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.478017 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.478352 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.478664 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.479008 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.479319 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.479633 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.479948 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.480262 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.480571 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.480886 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.481201 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.481652 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.481863 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.482178 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.482487 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.482817 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.483126 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.483436 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.483753 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.484069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.484378 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.485521 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.485521 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.485898 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.485898 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.486200 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.486542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.486880 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.487190 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.487627 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.487936 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.488156 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.488467 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.488784 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.489092 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.489403 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.489740 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.490058 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.490369 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.490678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.490986 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.491294 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.491698 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.491960 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.492230 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.492608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.493170 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.493170 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.493715 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.493862 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.494191 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.494498 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.494949 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.495115 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.495412 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.495733 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.496049 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.496365 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.496680 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.496994 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.497317 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.497653 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.497979 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.498296 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.498624 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.498948 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.499270 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.499578 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.499898 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.500243 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.501110 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.501652 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.502233 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.502511 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.502836 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.503156 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.503478 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.503793 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.504108 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.504431 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.504744 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.505068 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.505381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.505743 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.506059 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.506381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.506689 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.506880 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 04 16:12:55.507300 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.507387 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 04 16:12:55.507476 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.507638 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.507723 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 04 16:12:55.507949 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.508048 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 04 16:12:55.508264 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.508363 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 04 16:12:55.508589 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.508690 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.508902 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.508999 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.509216 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.509319 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.509529 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.509686 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.509861 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.509951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.510170 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.510260 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.510483 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.510580 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.511059 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.511265 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.511373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.511469 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.511670 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.511759 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.511973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.512078 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.512293 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.512436 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852364-6-iscsi {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.512602 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.512761 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.512909 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.513071 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.513220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.513389 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.513515 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.513748 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.513863 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.514056 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.514169 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.514379 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.514485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.514686 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.514785 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.515085 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.515188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.515394 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.515530 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.515718 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.515823 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.516030 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.516229 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.516610 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.516700 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.516940 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.517184 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.517281 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.517504 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.517623 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.517859 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.517956 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.518174 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.518288 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.518492 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.518587 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.518803 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.518900 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.519114 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.519210 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852364-6-iscsi {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.519433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.519530 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.519748 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.519853 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.520060 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.520179 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.520386 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.520540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.520685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.520848 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.521002 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.521146 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.521296 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.521439 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.521614 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.521764 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.521926 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.522070 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.522220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.522397 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.522550 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.522702 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.522857 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.523031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.523188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.523332 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.523488 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.523648 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.523925 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.524084 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.524237 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.524389 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.525248 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.525412 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.525412 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.525740 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.525887 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.526031 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.526194 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.526339 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.526483 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.526625 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.526766 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.526916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.527071 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.527224 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.527376 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.527535 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.527688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.527688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.527981 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.528134 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.528277 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.528444 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.529675 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.529952 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.530044 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.530128 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.530201 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.530201 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.530349 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.530427 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.530498 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.530567 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.530647 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.530718 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.530787 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.530855 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.530931 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.531009 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.531236 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.531341 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.531416 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.531544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.531652 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.532695 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.532800 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.532885 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.532989 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.533157 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.533268 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.533361 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.533361 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.533726 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.533838 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.533838 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.534164 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.534271 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.534427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.534514 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.534612 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.534703 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.534910 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.535015 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.535107 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.535196 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.535289 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.535379 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.535467 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.535562 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.535646 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.535734 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.535817 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.536058 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.536168 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.536357 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.536447 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.536663 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.536753 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.536988 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.537083 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.537243 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.537334 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.537548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.537660 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.537886 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.537985 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.538195 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.538283 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.538505 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.538595 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.538809 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.538908 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.539116 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.539203 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.539419 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.539516 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.539726 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.539824 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.540033 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.540121 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.540333 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.540426 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.540642 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.540841 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.541014 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.541167 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.541336 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.541497 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.541706 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.541862 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.542020 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.542178 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.542329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.542485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.542645 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.542797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.542797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.543100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.543259 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.543417 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.543584 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.543735 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.543885 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.544048 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.544199 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.544362 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.544514 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.544663 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.544818 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.544978 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.545152 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.545303 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.545459 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.545642 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.545800 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.545961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.546119 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.546281 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.546431 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.546590 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.546749 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.546908 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.547070 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.547221 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.547436 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.547593 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.547758 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.547910 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.548069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.548218 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.548379 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.548529 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.548692 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.548876 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.549039 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.549210 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.549369 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.549526 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.549693 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.549789 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.549871 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.549951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.550041 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.550171 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.550264 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.550474 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.550571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.550777 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.550866 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.551079 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.551176 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.551382 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.551483 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.551682 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.551770 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.551987 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.552084 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.552293 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.552382 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.552602 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.552705 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.552913 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.553015 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.553214 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.553302 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 04 16:12:55.553524 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.553650 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.553855 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.554023 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.554184 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.554338 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.554488 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.554647 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.554845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.555010 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.555169 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.555326 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.555478 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.555643 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.555802 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.555952 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.556101 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.556251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.556409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.556568 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.556734 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.556902 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.557063 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.557224 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.557389 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.557540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.557840 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.558002 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.558153 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.558303 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.558469 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.558628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.558813 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.558977 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.559141 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.559299 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.559462 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.559615 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.559764 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.559937 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.560093 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.560249 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.560413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.560564 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.560721 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.560889 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.561047 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.561216 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.561373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.561524 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.561774 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.561935 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.562092 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.562318 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.562471 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.562628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.562786 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.563483 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.563646 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.563824 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.564018 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.564290 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.564451 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.564451 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.564737 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.564901 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.565063 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.565222 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.565380 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.565531 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.565724 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.565879 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.566048 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.566207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.566358 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.566507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.566665 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.566824 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.566976 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.567126 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.567276 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.567432 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.567591 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.567748 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.567898 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.568084 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.568250 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.568416 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.568574 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.568733 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.568884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.569035 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.569184 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.569343 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.569503 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.569713 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.569867 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.570027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.570189 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.570359 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.570518 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.570677 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.570835 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.570986 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.571144 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.571308 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.571478 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.571629 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.571780 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.571930 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.572104 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.572257 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.572408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.572558 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.572708 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.572866 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.573031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.573183 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.573335 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.573484 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.573656 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.573819 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.573984 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.574150 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.574309 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.574467 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.574626 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.574776 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.574936 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.575087 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.575237 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.575388 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.575545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.575710 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.575869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.575869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.576165 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.576316 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.576474 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.576635 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.576786 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.576950 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.577101 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.577252 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.577403 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.577592 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.577751 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.577913 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.578075 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.578234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.578392 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.578603 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.579249 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.579545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.579713 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.579872 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.580031 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.580182 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.580333 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.580482 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.580669 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.580856 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.581033 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.581033 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.581326 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.581492 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.581668 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.581818 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.581985 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.582144 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.582296 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.582446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.582595 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.582753 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.582923 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.583083 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.583233 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.583382 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.583540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.583706 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.583858 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.584008 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.584157 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.584157 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.584456 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.584615 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.584767 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.584935 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.585093 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.585245 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.585403 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.585643 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.585814 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.585966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.586116 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.586273 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.586424 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.586584 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.586742 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.586907 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.587066 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.587223 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.587387 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.587537 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.587687 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.587837 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.587987 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.588136 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.588330 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.588492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.588643 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.588793 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.588962 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.589124 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.589283 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.589441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.589616 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.589616 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.589927 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.590085 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.590250 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.590401 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.590559 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.590716 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.590866 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.591036 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.591188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.591337 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.591500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.591663 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.591821 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.591979 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.592131 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.592287 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.592437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.592593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.592743 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.592907 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.593075 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.593226 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.593376 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.593532 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.593746 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.593907 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.594059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.594280 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.594487 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.594649 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.594815 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.594815 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.595222 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.595379 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.595537 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.595689 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.595921 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.595921 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.596210 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.596362 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.596362 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.596647 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.596809 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.596961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.597119 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.597281 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.597432 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.597608 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.597776 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.597935 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.598086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.598244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.598396 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.598555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.598713 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.598871 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.599022 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.599178 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.599345 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.599507 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.599658 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.599808 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.599957 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.600106 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.600255 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.600414 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.600574 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.600726 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.600875 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.601025 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.601181 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.601350 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.601514 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.601710 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.601863 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.602022 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.602179 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.602344 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.602503 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.602653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.602810 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.602968 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.603211 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.603424 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.603578 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.603730 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.603879 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.604037 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.604202 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.604354 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.604504 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.604656 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.604805 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.604954 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.605113 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.605264 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.605425 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.605594 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.605753 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.605904 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.606066 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.606218 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.606368 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.606517 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.606674 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.606840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.606840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.607142 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.607293 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.607456 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.607615 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.607774 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.607934 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.608092 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.608250 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.608407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.608568 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.608732 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.608884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.609033 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.609182 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.609339 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.609499 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.609705 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.609945 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.610177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.610357 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.610509 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.610672 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.610831 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.610983 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.611159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.611321 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.611488 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.611666 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.611826 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.611978 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.612129 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.612129 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.612431 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.612595 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.612746 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.612896 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.613047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.613204 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.613367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.613536 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.613713 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.613864 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.614028 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.614181 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.614340 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.614497 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.614647 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.614796 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.614796 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.615093 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.615245 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.615394 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.615553 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.615703 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.615860 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.616024 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.616176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.616335 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.616485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.616635 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.616784 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.616946 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.617103 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.617255 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.617414 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.617610 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.617768 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.617937 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.618097 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.618256 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.618408 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.618565 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.618726 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.618877 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.619026 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.619190 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.619341 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.619509 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.619669 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.619827 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.619978 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.620136 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.620286 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.620437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.620600 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.620752 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.620903 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.621070 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.621223 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.621391 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.621545 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.621717 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.621878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.622043 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.622201 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.622361 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.622521 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.622671 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.622828 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.622989 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.623146 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.623304 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.623471 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.623624 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.623774 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.623937 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.624088 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.624238 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.624401 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.624565 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.624725 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.624883 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.624883 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.625184 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.625345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.626154 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.626311 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.626463 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.626615 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.626774 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.626934 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.627092 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.627242 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.627400 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.627551 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.627959 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.628134 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.628287 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.628458 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.628611 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.628762 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.628919 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.628919 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.629215 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.629215 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.629507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.629685 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.629837 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.629837 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.630144 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.630314 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.630480 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.630633 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.630797 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.630952 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.631102 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.631252 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.631417 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.631579 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.631739 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.631890 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.632049 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.632200 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.632370 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.632530 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.632690 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.632848 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.633001 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.633158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.633317 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.633475 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.633660 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.633818 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.633968 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.634118 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.634267 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.634436 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.634595 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.634747 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.634897 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.635054 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.635213 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.635373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.635531 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.635695 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.636108 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.636261 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.636421 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.636581 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.636753 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.636913 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.637064 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.637215 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.637365 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.637525 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.637711 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.637863 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.638025 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.638183 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.638344 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.638495 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.638656 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.638806 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.638957 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.639106 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.639270 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.639421 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.639571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.639729 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.639880 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.639880 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.640189 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.640342 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.640491 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.640652 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.640810 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.640961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.641203 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.641371 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.641371 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.641734 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.641949 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.642115 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.642267 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.642426 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.642578 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.642736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.642899 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.643059 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.643219 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.643370 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.643523 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.643680 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.643832 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.643992 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.644143 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.644300 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.644300 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.644596 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.644755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.644924 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.645076 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.645227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.645385 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.645536 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.645743 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.645896 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.646055 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.646206 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.646363 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.646514 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.646679 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.646841 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.646991 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.647148 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.647300 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.647458 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.647618 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.647778 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.647929 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.648081 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.648231 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.648390 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.648548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.648700 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.648868 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.649027 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.649184 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.649344 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.649496 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.649671 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.649824 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.649985 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.650137 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.650298 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.650450 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.650607 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.650776 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.650935 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.651093 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.651253 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.651415 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.651581 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.651733 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.651894 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.652053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.652205 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.652355 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.652512 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.652669 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.652832 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.652991 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.653156 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.653307 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.653472 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.653697 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.653908 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.654138 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.669955 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.670128 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.670274 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.670367 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.670449 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.670532 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.670612 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.670708 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.670795 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.670880 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.670971 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.671057 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.671141 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.671233 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.671314 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.671388 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.671468 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.671561 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.671648 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.671736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.671829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.671921 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.672018 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.672104 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.672195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.672788 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.672883 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.672976 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.673062 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.673135 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.673206 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.673277 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.673349 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.673434 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.673527 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.673664 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.673760 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.673847 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.673938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.674032 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.674126 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.674220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.674220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.674383 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.674477 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.674647 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.674735 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.674826 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.674936 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.675025 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.675122 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.675365 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.675455 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.675541 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.675627 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.675725 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.675825 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.675912 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.675996 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.676087 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.676172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.676256 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.676348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.676348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.676505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.676579 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.676663 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.676748 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.676845 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.676931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.677064 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.677168 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.677257 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.677257 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.677436 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.677520 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.677621 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.677706 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.677802 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.677901 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.677993 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.677993 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.678141 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.678230 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.678314 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.678405 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.678490 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.678579 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.678669 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.678752 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.678835 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.679086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.679197 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.679289 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.679373 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.679470 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.679562 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.679654 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.679749 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.679832 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.679913 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.680002 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.680092 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.680181 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.680261 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.680340 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.680423 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.680502 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.680581 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.680664 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.680746 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.680828 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.680923 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.680996 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.681074 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.681165 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.681256 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.681346 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.681436 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.681532 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.681654 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.681741 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.681823 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.681919 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.682004 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.682096 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.682189 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.682281 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.682365 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.682449 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.682532 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.682624 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.682624 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.682784 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.682867 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.682962 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.683053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.683137 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.683227 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.683319 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.683409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.683409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.683574 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.683665 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.683755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.683845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.683935 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.684025 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.684122 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.684212 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.684296 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.684388 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.684471 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.684554 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.684649 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.684734 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.684822 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.684911 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.685001 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.685100 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.685190 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.685990 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.686097 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.686183 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.686183 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121040) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 04 16:12:55.686361 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.686361 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.686361 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.686361 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.686361 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.686361 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.686361 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.686361 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.686924 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.686924 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.686924 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.686924 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.686924 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.686924 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.686924 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.686924 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.687506 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.687506 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.687506 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.687506 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.687506 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.687506 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.687506 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.687506 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.688682 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.688682 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.688682 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.688682 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.688682 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.688682 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.688682 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.688682 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.689273 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.689273 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.689273 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.689273 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.689588 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.689672 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.689975 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.690294 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.690605 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.690918 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.691235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.691544 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.691855 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.692163 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.692495 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.692806 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.693259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.693436 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.693772 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.694083 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.694391 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.694738 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.695047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.695388 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.695696 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.696026 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.696344 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.696662 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.696982 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.697299 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.697646 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.697966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.698282 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.698597 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.698917 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.699234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.699555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.700118 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.700450 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.700769 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.701086 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.701405 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.701753 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.702070 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.702387 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.702702 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.703015 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.703333 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.703795 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.704397 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.704803 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.705149 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.705472 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.705822 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.706142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.706461 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.706821 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.707140 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.707452 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.707770 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.708088 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.708405 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.708717 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.709028 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.709350 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.709668 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.709985 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.710301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.710611 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.710928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.711268 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.711590 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.711912 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.712227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.712545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.712865 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.713393 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.713736 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.714076 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.714405 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.714732 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.715053 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.715373 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.715702 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.716015 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.716321 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.716633 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.716946 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.717256 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.717596 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.717916 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.718225 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.718547 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.718861 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.719590 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.720105 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.720440 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.720781 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.721117 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.721445 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.721801 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.722138 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.722454 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.722768 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.723092 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.723410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.723720 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.724032 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.724348 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.724663 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.725144 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.725301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.725596 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.725931 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.726244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.726552 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.726859 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.727173 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.727479 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.727785 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.728092 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.728399 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.728714 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.729022 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.729428 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.729762 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.730083 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.730449 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.730767 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.731069 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.731398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.731708 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.732016 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.732333 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.732647 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.732972 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.733292 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.733623 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.733977 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.734300 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.735377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.735964 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.736368 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.736728 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.737071 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.737388 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.737733 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.738052 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.738384 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.738703 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.739026 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.739212 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO dbcounter [None req-bcb50a31-01b7-419d-92a5-4ed74340acd1 None None] Registered counter for database nova_api Sep 04 16:12:55.739353 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.739646 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.739963 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.740280 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.740602 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.740917 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.741232 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.741545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.741882 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.742197 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.742554 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.742874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.743195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.743545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.743868 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.744190 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.744510 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.744828 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.745144 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.745462 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.745805 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.746117 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.746434 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.746766 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.747089 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.747400 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.747831 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.748149 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.748473 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.748796 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.749108 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.749435 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.749786 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.750102 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.750494 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.751488 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.752092 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.752452 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.752798 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.753131 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.753447 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.753795 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.754114 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.754429 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.754754 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.755267 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.755373 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.755682 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.756310 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.756310 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.756737 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.756897 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.757166 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.757480 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.757814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.758149 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.758461 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.758772 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.759080 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.759386 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.759699 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.760004 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.760311 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.760616 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.760753 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_db.sqlalchemy.engines [None req-bcb50a31-01b7-419d-92a5-4ed74340acd1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121040) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 16:12:55.761184 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.761488 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.761868 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.762208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.762530 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.762857 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.763174 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.763502 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.763894 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.764228 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.764552 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.764875 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.765191 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.765535 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.765878 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.766372 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.766895 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.767411 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.767593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writer thread running {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 16:12:55.767739 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.768057 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.768393 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.768725 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.769037 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.769367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.769738 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.770065 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.770387 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.770702 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.771035 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.771351 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.771697 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.771977 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.772292 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.772608 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.772927 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.773241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.773556 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.773900 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.774223 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.774556 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.774888 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.775204 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.775560 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.775877 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.776237 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.776589 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.776941 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.777273 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.777676 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.778490 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.778490 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 04 16:12:55.778490 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121041) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 04 16:12:55.837726 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.context [None req-bcb50a31-01b7-419d-92a5-4ed74340acd1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a86cec77-539a-4bf3-943b-16bf2a859513(cell1) {{(pid=121040) load_cells /opt/stack/nova/nova/context.py:464}} Sep 04 16:12:55.841833 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bcb50a31-01b7-419d-92a5-4ed74340acd1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:12:55.842310 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bcb50a31-01b7-419d-92a5-4ed74340acd1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:12:55.843869 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bcb50a31-01b7-419d-92a5-4ed74340acd1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:12:55.844630 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bcb50a31-01b7-419d-92a5-4ed74340acd1 None None] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:12:55.845078 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bcb50a31-01b7-419d-92a5-4ed74340acd1 None None] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:12:55.847104 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bcb50a31-01b7-419d-92a5-4ed74340acd1 None None] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:12:55.847609 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO dbcounter [None req-d6a6e66e-c557-4a7c-b6fd-5e1eeec3c279 None None] Registered counter for database nova_api Sep 04 16:12:55.849144 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO dbcounter [None req-bcb50a31-01b7-419d-92a5-4ed74340acd1 None None] Registered counter for database nova_cell0 Sep 04 16:12:55.853296 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO dbcounter [None req-bcb50a31-01b7-419d-92a5-4ed74340acd1 None None] Registered counter for database nova_cell1 Sep 04 16:12:55.861994 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_db.sqlalchemy.engines [None req-bcb50a31-01b7-419d-92a5-4ed74340acd1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121040) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 16:12:55.864843 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_db.sqlalchemy.engines [None req-bcb50a31-01b7-419d-92a5-4ed74340acd1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121040) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 16:12:55.867686 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writer thread running {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 16:12:55.868511 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_db.sqlalchemy.engines [None req-d6a6e66e-c557-4a7c-b6fd-5e1eeec3c279 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121041) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 16:12:55.874950 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writer thread running {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 16:12:55.933166 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.context [None req-d6a6e66e-c557-4a7c-b6fd-5e1eeec3c279 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a86cec77-539a-4bf3-943b-16bf2a859513(cell1) {{(pid=121041) load_cells /opt/stack/nova/nova/context.py:464}} Sep 04 16:12:55.937148 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d6a6e66e-c557-4a7c-b6fd-5e1eeec3c279 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:12:55.937648 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d6a6e66e-c557-4a7c-b6fd-5e1eeec3c279 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:12:55.940258 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d6a6e66e-c557-4a7c-b6fd-5e1eeec3c279 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:12:55.941000 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d6a6e66e-c557-4a7c-b6fd-5e1eeec3c279 None None] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:12:55.941454 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d6a6e66e-c557-4a7c-b6fd-5e1eeec3c279 None None] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:12:55.943474 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d6a6e66e-c557-4a7c-b6fd-5e1eeec3c279 None None] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:12:55.945459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO dbcounter [None req-d6a6e66e-c557-4a7c-b6fd-5e1eeec3c279 None None] Registered counter for database nova_cell0 Sep 04 16:12:55.949511 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO dbcounter [None req-d6a6e66e-c557-4a7c-b6fd-5e1eeec3c279 None None] Registered counter for database nova_cell1 Sep 04 16:12:55.958062 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_db.sqlalchemy.engines [None req-d6a6e66e-c557-4a7c-b6fd-5e1eeec3c279 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121041) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 16:12:55.959868 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_db.sqlalchemy.engines [None req-d6a6e66e-c557-4a7c-b6fd-5e1eeec3c279 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121041) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 16:12:55.966944 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writer thread running {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 16:12:55.968239 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writer thread running {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 16:12:56.017974 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writer thread running {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 16:12:56.026692 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO dbcounter [None req-bcb50a31-01b7-419d-92a5-4ed74340acd1 None None] Registered counter for database nova_cell0 Sep 04 16:12:56.033808 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_db.sqlalchemy.engines [None req-bcb50a31-01b7-419d-92a5-4ed74340acd1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121040) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 16:12:56.040809 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writer thread running {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 16:12:56.124424 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO dbcounter [None req-d6a6e66e-c557-4a7c-b6fd-5e1eeec3c279 None None] Registered counter for database nova_cell0 Sep 04 16:12:56.131234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_db.sqlalchemy.engines [None req-d6a6e66e-c557-4a7c-b6fd-5e1eeec3c279 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121041) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 04 16:12:56.136179 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writer thread running {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 04 16:12:56.377598 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: WARNING keystonemiddleware.auth_token [None req-bcb50a31-01b7-419d-92a5-4ed74340acd1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 04 16:12:56.384934 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: WARNING keystonemiddleware.auth_token [None req-bcb50a31-01b7-419d-92a5-4ed74340acd1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 04 16:12:56.458142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: WARNING keystonemiddleware.auth_token [None req-d6a6e66e-c557-4a7c-b6fd-5e1eeec3c279 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 04 16:12:56.465405 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: WARNING keystonemiddleware.auth_token [None req-d6a6e66e-c557-4a7c-b6fd-5e1eeec3c279 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 04 16:12:56.739838 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: WARNING keystonemiddleware.auth_token [None req-bcb50a31-01b7-419d-92a5-4ed74340acd1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 04 16:12:56.746155 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: WARNING keystonemiddleware.auth_token [None req-bcb50a31-01b7-419d-92a5-4ed74340acd1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 04 16:12:56.752645 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ae9119e9c0 pid: 121040 (default app) Sep 04 16:12:56.816955 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: WARNING keystonemiddleware.auth_token [None req-d6a6e66e-c557-4a7c-b6fd-5e1eeec3c279 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 04 16:12:56.823290 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: WARNING keystonemiddleware.auth_token [None req-d6a6e66e-c557-4a7c-b6fd-5e1eeec3c279 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 04 16:12:56.828678 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ae9119e9c0 pid: 121041 (default app) Sep 04 16:13:33.460439 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:13:33.462205 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:13:33.463560 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:13:33.465047 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:13:34.792586 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4ff27c76-2491-4865-b2e7-dd6d03e6f880 tempest-VolumesGetTestJSON-255992649 tempest-VolumesGetTestJSON-255992649-project] Action: 'create', calling method: .version_select at 0x7f968a1a0280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1679426825", "metadata": {"Type": "work"}}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:13:37.292146 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4ff27c76-2491-4865-b2e7-dd6d03e6f880 tempest-VolumesGetTestJSON-255992649 tempest-VolumesGetTestJSON-255992649-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.854694 Sep 04 16:13:37.293415 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 1/1] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Sep 4 16:13:33 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3857 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 04 16:13:37.311124 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=3 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:13:37.312132 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=3 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:13:37.312850 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=3 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:13:37.314574 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=3 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:13:37.677869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-573ab25f-eef5-4fe4-9983-ff61da778a1b tempest-VolumesGetTestJSON-255992649 tempest-VolumesGetTestJSON-255992649-project] Calling method '.version_select at 0x7f968a25aee0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:13:38.583417 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-573ab25f-eef5-4fe4-9983-ff61da778a1b tempest-VolumesGetTestJSON-255992649 tempest-VolumesGetTestJSON-255992649-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/8135b1b5-21c4-4b1e-9849-532588949f08" status: 200 len: 354 microversion: 2.1 time: 1.276654 Sep 04 16:13:38.584320 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 1/2] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Sep 4 16:13:37 2022] GET /compute/v2.1/os-volumes/8135b1b5-21c4-4b1e-9849-532588949f08 => generated 354 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:13:38.598366 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1dabb3be-73ef-4c46-8152-0efdb973e8e6 tempest-VolumesGetTestJSON-255992649 tempest-VolumesGetTestJSON-255992649-project] Calling method '.version_select at 0x7f968a082160>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:13:38.774955 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1dabb3be-73ef-4c46-8152-0efdb973e8e6 tempest-VolumesGetTestJSON-255992649 tempest-VolumesGetTestJSON-255992649-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/8135b1b5-21c4-4b1e-9849-532588949f08" status: 200 len: 354 microversion: 2.1 time: 0.180706 Sep 04 16:13:38.775990 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Sep 4 16:13:38 2022] GET /compute/v2.1/os-volumes/8135b1b5-21c4-4b1e-9849-532588949f08 => generated 354 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:13:38.797457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-dcad553f-90a9-4c0b-994c-a1c87d28e631 tempest-VolumesGetTestJSON-255992649 tempest-VolumesGetTestJSON-255992649-project] Calling method '.version_select at 0x7f968a05e160>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:13:39.162344 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-dcad553f-90a9-4c0b-994c-a1c87d28e631 tempest-VolumesGetTestJSON-255992649 tempest-VolumesGetTestJSON-255992649-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/8135b1b5-21c4-4b1e-9849-532588949f08" status: 202 len: 0 microversion: 2.1 time: 0.368952 Sep 04 16:13:39.171828 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6c3ff3cf-c731-42fa-a31d-2f5a3e5b1fc5 tempest-VolumesGetTestJSON-255992649 tempest-VolumesGetTestJSON-255992649-project] Calling method '.version_select at 0x7f968a0828b0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:13:39.173332 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Sep 4 16:13:38 2022] DELETE /compute/v2.1/os-volumes/8135b1b5-21c4-4b1e-9849-532588949f08 => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:13:39.256605 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6c3ff3cf-c731-42fa-a31d-2f5a3e5b1fc5 tempest-VolumesGetTestJSON-255992649 tempest-VolumesGetTestJSON-255992649-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/8135b1b5-21c4-4b1e-9849-532588949f08" status: 200 len: 353 microversion: 2.1 time: 0.088626 Sep 04 16:13:39.264020 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 3/5] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Sep 4 16:13:39 2022] GET /compute/v2.1/os-volumes/8135b1b5-21c4-4b1e-9849-532588949f08 => generated 353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:13:40.272177 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c5253011-26de-4b6e-85d5-6f81b7f3f599 tempest-VolumesGetTestJSON-255992649 tempest-VolumesGetTestJSON-255992649-project] Calling method '.version_select at 0x7f968a05e820>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:13:40.479627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-c5253011-26de-4b6e-85d5-6f81b7f3f599 tempest-VolumesGetTestJSON-255992649 tempest-VolumesGetTestJSON-255992649-project] HTTP exception thrown: Volume 8135b1b5-21c4-4b1e-9849-532588949f08 could not be found. Sep 04 16:13:40.483829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c5253011-26de-4b6e-85d5-6f81b7f3f599 tempest-VolumesGetTestJSON-255992649 tempest-VolumesGetTestJSON-255992649-project] Request method failure captured: Sep 04 16:13:40.483829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/os-volumes/8135b1b5-21c4-4b1e-9849-532588949f08 HTTP/1.1 Sep 04 16:13:40.483829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:13:40.483829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:13:40.483829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:13:40.483829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:13:40.483829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:13:40.483829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:13:40.483829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:13:40.483829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:13:40.483829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFM6tGVthVcQvS_mQtaREsfMZxpDDRspQo8mx-2KAl5888otbhsG81uR4KiV6uyBg2gkUNCNQVa92smsscq5TMfPqnvS5z3kKMeDhxTyzgkDy_jnvy85XLr6IiK_6I6-881H_SENHuo9V5FGuPr3haPYI0diQRLvO1MQFSK60sqaWj8c Sep 04 16:13:40.483829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:13:40.483829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:13:40.483829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:13:40.483829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:13:40.483829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:13:40.483829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:13:40.483829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: f7786c29c31642a4a02db494e8a57e59 Sep 04 16:13:40.483829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-VolumesGetTestJSON-255992649 Sep 04 16:13:40.483829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:13:40.483829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:13:40.485239 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f7786c29c31642a4a02db494e8a57e59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f7786c29c31642a4a02db494e8a57e59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f7786c29c31642a4a02db494e8a57e59", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f7786c29c31642a4a02db494e8a57e59"}]}] Sep 04 16:13:40.485239 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-VolumesGetTestJSON-255992649 Sep 04 16:13:40.485239 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: f7786c29c31642a4a02db494e8a57e59 Sep 04 16:13:40.485239 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-VolumesGetTestJSON-255992649 Sep 04 16:13:40.485239 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-VolumesGetTestJSON-255992649-project Sep 04 16:13:40.485239 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:13:40.485239 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:13:40.485239 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: dd48767bd3fa451fbeb5bbf40084d6b0 Sep 04 16:13:40.485239 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-VolumesGetTestJSON-255992649-project Sep 04 16:13:40.485239 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: Sep 04 16:13:40.485239 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Volume 8135b1b5-21c4-4b1e-9849-532588949f08 could not be found. Sep 04 16:13:40.485239 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': '8135b1b5-21c4-4b1e-9849-532588949f08'} Sep 04 16:13:40.485239 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:13:40.486291 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:13:40.486291 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 16:13:40.486291 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 16:13:40.486291 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 04 16:13:40.486291 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 04 16:13:40.486291 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 04 16:13:40.486291 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 04 16:13:40.486291 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 04 16:13:40.486291 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 04 16:13:40.486291 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 04 16:13:40.486291 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 04 16:13:40.486291 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 16:13:40.486291 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 16:13:40.486291 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 16:13:40.486291 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 16:13:40.486291 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8135b1b5-21c4-4b1e-9849-532588949f08 could not be found. (HTTP 404) (Request-ID: req-d4c31e88-67e0-4f27-8108-05560ae6417f) Sep 04 16:13:40.486291 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:13:40.486291 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:13:40.486291 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:13:40.487548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:13:40.487548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 04 16:13:40.487548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 04 16:13:40.487548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 04 16:13:40.487548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 04 16:13:40.487548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 04 16:13:40.487548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 04 16:13:40.487548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 04 16:13:40.487548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 04 16:13:40.487548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 16:13:40.487548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 16:13:40.487548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 04 16:13:40.487548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 04 16:13:40.487548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 04 16:13:40.487548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 04 16:13:40.487548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 04 16:13:40.487548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 04 16:13:40.487548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 04 16:13:40.487548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 04 16:13:40.488401 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 16:13:40.488401 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 16:13:40.488401 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 16:13:40.488401 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 16:13:40.488401 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8135b1b5-21c4-4b1e-9849-532588949f08 could not be found. Sep 04 16:13:40.488401 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:13:40.488401 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:13:40.488401 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:13:40.488401 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:13:40.488401 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:13:40.488401 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:13:40.488401 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:13:40.488401 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:13:40.488401 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 04 16:13:40.488401 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 04 16:13:40.488401 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:13:40.488401 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:13:40.488401 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 04 16:13:40.488401 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:13:40.490677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8135b1b5-21c4-4b1e-9849-532588949f08 could not be found. Sep 04 16:13:40.490677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:13:40.490677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:13:40.490677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:13:40.490677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:13:40.490677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:13:40.490677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:13:40.490677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:13:40.490677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:13:40.490677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8135b1b5-21c4-4b1e-9849-532588949f08 could not be found. Sep 04 16:13:40.490677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:13:40.490677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c5253011-26de-4b6e-85d5-6f81b7f3f599 tempest-VolumesGetTestJSON-255992649 tempest-VolumesGetTestJSON-255992649-project] Returning 404 to user: Volume 8135b1b5-21c4-4b1e-9849-532588949f08 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:13:40.490677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c5253011-26de-4b6e-85d5-6f81b7f3f599 tempest-VolumesGetTestJSON-255992649 tempest-VolumesGetTestJSON-255992649-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/8135b1b5-21c4-4b1e-9849-532588949f08" status: 404 len: 109 microversion: 2.1 time: 0.217640 Sep 04 16:13:40.492026 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 3/6] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Sep 4 16:13:40 2022] GET /compute/v2.1/os-volumes/8135b1b5-21c4-4b1e-9849-532588949f08 => generated 109 bytes in 225 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:13:47.187207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a01166c8-c662-4b0c-97d1-ae7539431921 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Action: 'create', calling method: .version_select at 0x7f968a082e50>, body: {"keypair": {"name": "tempest-keypair-1200794846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUPr6FWdgBdKwOLkaOUsonkvF+y1xO+RO8NrhiwyOaF/suXctILOkeCc4vJXPX0IeaP0YJ9Swp29QmBttIl15vDaLgbvjsarZAz70At5IYDV9xfQRs0bkcpsBlIxUqbrQ=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:13:47.296509 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-a01166c8-c662-4b0c-97d1-ae7539431921 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Getting quotas for project 3219dc7400ec4957a31b1b0fabfd8c56. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:13:47.315804 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-a01166c8-c662-4b0c-97d1-ae7539431921 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Getting quotas for user 1623e93ad6844cacae7cc1a71b339f22 and project 3219dc7400ec4957a31b1b0fabfd8c56. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:13:47.491796 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a01166c8-c662-4b0c-97d1-ae7539431921 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.797615 Sep 04 16:13:47.492855 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 4/7] 10.222.0.39 () {62 vars in 1200 bytes} [Sun Sep 4 16:13:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 799 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 04 16:13:48.325479 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-58a215d6-22fa-47bd-8770-9f76ad05db9b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1706533684", "imageRef": "11a460f6-29b0-46e6-ae98-e53ee2e13520", "flavorRef": "452", "networks": [{"uuid": "20f718a7-f41d-48a2-8822-cd43d3405a61"}]}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:13:48.657335 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-58a215d6-22fa-47bd-8770-9f76ad05db9b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] validate_networks() for [('20f718a7-f41d-48a2-8822-cd43d3405a61', None, None, None, None, None)] {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 16:13:50.475632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-58a215d6-22fa-47bd-8770-9f76ad05db9b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 16:13:50.476765 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-58a215d6-22fa-47bd-8770-9f76ad05db9b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 16:13:50.477405 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-58a215d6-22fa-47bd-8770-9f76ad05db9b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 16:13:50.478212 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-58a215d6-22fa-47bd-8770-9f76ad05db9b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 16:13:50.479036 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-58a215d6-22fa-47bd-8770-9f76ad05db9b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 16:13:50.552951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-58a215d6-22fa-47bd-8770-9f76ad05db9b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:13:50.553443 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-58a215d6-22fa-47bd-8770-9f76ad05db9b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:13:50.553912 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-58a215d6-22fa-47bd-8770-9f76ad05db9b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:13:50.554639 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-58a215d6-22fa-47bd-8770-9f76ad05db9b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:13:50.557408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-58a215d6-22fa-47bd-8770-9f76ad05db9b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:13:50.561704 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-58a215d6-22fa-47bd-8770-9f76ad05db9b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:13:50.614832 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-58a215d6-22fa-47bd-8770-9f76ad05db9b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Getting quotas for project 17338e3b6b204595a43fddc1c00ed26b. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:13:50.621735 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-58a215d6-22fa-47bd-8770-9f76ad05db9b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Getting quotas for user f1af03ad31a34f319763a6b5451ae26e and project 17338e3b6b204595a43fddc1c00ed26b. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:13:50.657933 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-58a215d6-22fa-47bd-8770-9f76ad05db9b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 16:13:50.662906 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-58a215d6-22fa-47bd-8770-9f76ad05db9b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a460f6-29b0-46e6-ae98-e53ee2e13520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 16:13:50.926108 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-58a215d6-22fa-47bd-8770-9f76ad05db9b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.906435 Sep 04 16:13:50.934662 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 4/8] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Sep 4 16:13:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 16:13:50.941153 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1784ed72-dc82-4d8d-93b3-e740a4a1ba36 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:13:50.942043 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1784ed72-dc82-4d8d-93b3-e740a4a1ba36 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:13:51.225102 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1784ed72-dc82-4d8d-93b3-e740a4a1ba36 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:13:51.271048 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1784ed72-dc82-4d8d-93b3-e740a4a1ba36 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1215 microversion: 2.1 time: 0.335442 Sep 04 16:13:51.280869 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 5/9] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:13:50 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1215 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:13:52.308797 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0bc5b08c-0941-4b44-869b-1e4276fbfcc3 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:13:52.310089 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0bc5b08c-0941-4b44-869b-1e4276fbfcc3 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:13:52.445621 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0bc5b08c-0941-4b44-869b-1e4276fbfcc3 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:13:52.493269 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0bc5b08c-0941-4b44-869b-1e4276fbfcc3 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1215 microversion: 2.1 time: 0.188747 Sep 04 16:13:52.495098 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 5/10] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:13:52 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1215 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:13:53.520177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fb31980a-fcc6-453b-b4a4-e241201d0d72 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:13:53.520904 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fb31980a-fcc6-453b-b4a4-e241201d0d72 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:13:53.659078 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-fb31980a-fcc6-453b-b4a4-e241201d0d72 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:13:53.684884 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fb31980a-fcc6-453b-b4a4-e241201d0d72 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1215 microversion: 2.1 time: 0.168014 Sep 04 16:13:53.688027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 6/11] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:13:53 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1215 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:13:54.545896 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d9cce5ed-43fd-4b9c-af37-2a62f27d33bd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1224509376", "imageRef": "11a460f6-29b0-46e6-ae98-e53ee2e13520", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:13:54.682283 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-d9cce5ed-43fd-4b9c-af37-2a62f27d33bd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] validate_networks() for [('a845be48-e7c6-44a4-9bea-76b6b11d7a03', None, None, None, None, None)] {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 16:13:55.041156 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-406c704f-baab-43ac-9536-6b0f772ab5d6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Action: 'create', calling method: .version_select at 0x7f9689fae8b0>, body: {"keypair": {"name": "tempest-keypair-1507779781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9q61tP9cTeo9rg4cGv1PAEI6TjOq7uh7HvNWr6S2COXJU5YFpUJLuNipkoolQxZd8zFoufKoLbNiNpXP33dXHLA6SzA23SUSQ7+s/Hns/dlIHlGP9zCkiyF0MVGT2O5Q=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:13:55.095025 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-406c704f-baab-43ac-9536-6b0f772ab5d6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Getting quotas for project 1cc5ea4158344d5c8a35bc5783410620. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:13:55.120497 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-406c704f-baab-43ac-9536-6b0f772ab5d6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Getting quotas for user 6e5c22b631df4600b9f920120b67fc67 and project 1cc5ea4158344d5c8a35bc5783410620. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:13:55.244130 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-406c704f-baab-43ac-9536-6b0f772ab5d6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.903179 Sep 04 16:13:55.248259 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 7/12] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Sep 4 16:13:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:13:55.256361 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c25e93e9-3829-4672-8113-d6021661b606 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:13:55.256983 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c25e93e9-3829-4672-8113-d6021661b606 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:13:55.313472 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c25e93e9-3829-4672-8113-d6021661b606 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:13:55.316712 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c25e93e9-3829-4672-8113-d6021661b606 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:13:55.317710 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c25e93e9-3829-4672-8113-d6021661b606 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:13:55.319297 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c25e93e9-3829-4672-8113-d6021661b606 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:13:55.321284 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c25e93e9-3829-4672-8113-d6021661b606 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:13:55.323076 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c25e93e9-3829-4672-8113-d6021661b606 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:13:55.471386 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-d9cce5ed-43fd-4b9c-af37-2a62f27d33bd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 16:13:55.471862 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-d9cce5ed-43fd-4b9c-af37-2a62f27d33bd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 16:13:55.472430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-d9cce5ed-43fd-4b9c-af37-2a62f27d33bd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 16:13:55.473073 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-d9cce5ed-43fd-4b9c-af37-2a62f27d33bd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 16:13:55.473518 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-d9cce5ed-43fd-4b9c-af37-2a62f27d33bd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 16:13:55.504092 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d9cce5ed-43fd-4b9c-af37-2a62f27d33bd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:13:55.505818 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d9cce5ed-43fd-4b9c-af37-2a62f27d33bd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:13:55.506676 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d9cce5ed-43fd-4b9c-af37-2a62f27d33bd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:13:55.509882 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d9cce5ed-43fd-4b9c-af37-2a62f27d33bd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:13:55.514188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d9cce5ed-43fd-4b9c-af37-2a62f27d33bd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:13:55.514853 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d9cce5ed-43fd-4b9c-af37-2a62f27d33bd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:13:55.597122 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-d9cce5ed-43fd-4b9c-af37-2a62f27d33bd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Getting quotas for project cb043a0ecad3466bbd5a5874126d2810. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:13:55.612301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-d9cce5ed-43fd-4b9c-af37-2a62f27d33bd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Getting quotas for user a9d55c52717546b09d93d956a29f49a9 and project cb043a0ecad3466bbd5a5874126d2810. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:13:55.657138 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d9cce5ed-43fd-4b9c-af37-2a62f27d33bd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 16:13:55.674947 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d9cce5ed-43fd-4b9c-af37-2a62f27d33bd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a460f6-29b0-46e6-ae98-e53ee2e13520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 16:13:55.752467 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c25e93e9-3829-4672-8113-d6021661b606 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:13:55.770503 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c25e93e9-3829-4672-8113-d6021661b606 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1267 microversion: 2.1 time: 0.519736 Sep 04 16:13:55.771937 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 8/13] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:13:55 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1267 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:13:55.778861 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8906b3f2-1e59-464e-8a90-0a3cfa0721b2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-373059617", "imageRef": "11a460f6-29b0-46e6-ae98-e53ee2e13520", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d8e80fc6-ad05-43a4-89cd-45fef4a75dff"}], "security_groups": [{"name": "tempest-securitygroup--1251130095"}], "key_name": "tempest-keypair-1200794846", "user_data": "}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:13:55.897723 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d9cce5ed-43fd-4b9c-af37-2a62f27d33bd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.072756 Sep 04 16:13:55.898555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 6/14] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Sep 4 16:13:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 2075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 16:13:55.919131 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b3e2a3e7-6da8-44b3-bae4-aca918174092 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:13:55.919770 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b3e2a3e7-6da8-44b3-bae4-aca918174092 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:13:56.140525 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b3e2a3e7-6da8-44b3-bae4-aca918174092 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:13:56.152318 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b3e2a3e7-6da8-44b3-bae4-aca918174092 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1222 microversion: 2.1 time: 0.243661 Sep 04 16:13:56.157183 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 7/15] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:13:55 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1222 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:13:56.454724 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d575e287-2c86-4377-b521-b2fcae1d988c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-864793161", "imageRef": "11a460f6-29b0-46e6-ae98-e53ee2e13520", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:13:56.608434 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-d575e287-2c86-4377-b521-b2fcae1d988c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] validate_networks() for [('a845be48-e7c6-44a4-9bea-76b6b11d7a03', None, None, None, None, None)] {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 16:13:56.716402 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-8906b3f2-1e59-464e-8a90-0a3cfa0721b2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] validate_networks() for [('d8e80fc6-ad05-43a4-89cd-45fef4a75dff', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 16:13:59.925700 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-d575e287-2c86-4377-b521-b2fcae1d988c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 16:13:59.926225 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-d575e287-2c86-4377-b521-b2fcae1d988c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 16:13:59.926778 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-d575e287-2c86-4377-b521-b2fcae1d988c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 16:13:59.933962 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-d575e287-2c86-4377-b521-b2fcae1d988c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 16:13:59.933962 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-d575e287-2c86-4377-b521-b2fcae1d988c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 16:13:59.950845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-8906b3f2-1e59-464e-8a90-0a3cfa0721b2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 16:13:59.951334 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-8906b3f2-1e59-464e-8a90-0a3cfa0721b2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 16:13:59.951816 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-8906b3f2-1e59-464e-8a90-0a3cfa0721b2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 16:13:59.952226 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-8906b3f2-1e59-464e-8a90-0a3cfa0721b2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 16:13:59.952640 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-8906b3f2-1e59-464e-8a90-0a3cfa0721b2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 16:13:59.960127 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d575e287-2c86-4377-b521-b2fcae1d988c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:13:59.965537 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d575e287-2c86-4377-b521-b2fcae1d988c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:13:59.966803 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d575e287-2c86-4377-b521-b2fcae1d988c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:13:59.968202 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d575e287-2c86-4377-b521-b2fcae1d988c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:13:59.971407 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d575e287-2c86-4377-b521-b2fcae1d988c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:13:59.975901 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d575e287-2c86-4377-b521-b2fcae1d988c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:13:59.976176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8906b3f2-1e59-464e-8a90-0a3cfa0721b2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:13:59.976932 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8906b3f2-1e59-464e-8a90-0a3cfa0721b2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:13:59.977888 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8906b3f2-1e59-464e-8a90-0a3cfa0721b2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:13:59.978779 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8906b3f2-1e59-464e-8a90-0a3cfa0721b2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:13:59.979495 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8906b3f2-1e59-464e-8a90-0a3cfa0721b2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:13:59.980246 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8906b3f2-1e59-464e-8a90-0a3cfa0721b2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:00.020869 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-8906b3f2-1e59-464e-8a90-0a3cfa0721b2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Getting quotas for project 3219dc7400ec4957a31b1b0fabfd8c56. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:14:00.052514 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-d575e287-2c86-4377-b521-b2fcae1d988c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Getting quotas for project cb043a0ecad3466bbd5a5874126d2810. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:14:00.099988 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-d575e287-2c86-4377-b521-b2fcae1d988c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Getting quotas for user a9d55c52717546b09d93d956a29f49a9 and project cb043a0ecad3466bbd5a5874126d2810. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:14:00.104114 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-8906b3f2-1e59-464e-8a90-0a3cfa0721b2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Getting quotas for user 1623e93ad6844cacae7cc1a71b339f22 and project 3219dc7400ec4957a31b1b0fabfd8c56. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:14:00.156033 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d575e287-2c86-4377-b521-b2fcae1d988c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 16:14:00.161957 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8906b3f2-1e59-464e-8a90-0a3cfa0721b2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 16:14:00.171651 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8906b3f2-1e59-464e-8a90-0a3cfa0721b2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a460f6-29b0-46e6-ae98-e53ee2e13520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 16:14:00.173109 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d575e287-2c86-4377-b521-b2fcae1d988c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a460f6-29b0-46e6-ae98-e53ee2e13520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 16:14:00.388802 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d575e287-2c86-4377-b521-b2fcae1d988c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.938694 Sep 04 16:14:00.404925 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 8/16] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Sep 4 16:13:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 3955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 16:14:00.416068 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6229a730-47c7-4917-9c05-f74c32f4848f tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:00.416860 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6229a730-47c7-4917-9c05-f74c32f4848f tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:00.437223 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6229a730-47c7-4917-9c05-f74c32f4848f tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:00.439341 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6229a730-47c7-4917-9c05-f74c32f4848f tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:00.441807 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6229a730-47c7-4917-9c05-f74c32f4848f tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:00.445250 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6229a730-47c7-4917-9c05-f74c32f4848f tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:00.447303 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6229a730-47c7-4917-9c05-f74c32f4848f tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:00.449785 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6229a730-47c7-4917-9c05-f74c32f4848f tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:00.453190 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8906b3f2-1e59-464e-8a90-0a3cfa0721b2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.679514 Sep 04 16:14:00.454416 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 9/17] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Sep 4 16:13:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 4682 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 04 16:14:00.492684 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bcdc73f0-610d-4bb4-b1d9-4000fc580643 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:00.493999 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bcdc73f0-610d-4bb4-b1d9-4000fc580643 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:00.818854 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-bcdc73f0-610d-4bb4-b1d9-4000fc580643 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:00.818854 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bcdc73f0-610d-4bb4-b1d9-4000fc580643 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1221 microversion: 2.1 time: 0.292878 Sep 04 16:14:00.818854 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 10/18] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:00 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1221 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:00.818854 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-58200b18-6dd4-4027-b884-63ae28590c4b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:00.819525 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-58200b18-6dd4-4027-b884-63ae28590c4b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:01.074653 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-58200b18-6dd4-4027-b884-63ae28590c4b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:01.103818 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-58200b18-6dd4-4027-b884-63ae28590c4b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:01.113433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-58200b18-6dd4-4027-b884-63ae28590c4b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:01.125789 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-58200b18-6dd4-4027-b884-63ae28590c4b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1281 microversion: 2.20 time: 0.357760 Sep 04 16:14:01.125789 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 11/19] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:00 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1281 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:01.495968 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6229a730-47c7-4917-9c05-f74c32f4848f tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:01.566366 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6229a730-47c7-4917-9c05-f74c32f4848f tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1315 microversion: 2.1 time: 1.158859 Sep 04 16:14:01.572469 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 9/20] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:00 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1315 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:01.849464 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-99b7f7ba-2612-405a-86c2-5cf0d8727be0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:01.855263 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-99b7f7ba-2612-405a-86c2-5cf0d8727be0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:02.025842 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-99b7f7ba-2612-405a-86c2-5cf0d8727be0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:02.040316 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-99b7f7ba-2612-405a-86c2-5cf0d8727be0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1221 microversion: 2.1 time: 0.197354 Sep 04 16:14:02.044653 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 12/21] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:01 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1221 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:02.145893 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-94e87df2-76e4-4d05-8298-bc150be5e6a2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:02.146567 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-94e87df2-76e4-4d05-8298-bc150be5e6a2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:02.386868 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-94e87df2-76e4-4d05-8298-bc150be5e6a2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:02.434046 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-94e87df2-76e4-4d05-8298-bc150be5e6a2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:02.443124 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-94e87df2-76e4-4d05-8298-bc150be5e6a2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:02.447364 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-94e87df2-76e4-4d05-8298-bc150be5e6a2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1281 microversion: 2.20 time: 0.306704 Sep 04 16:14:02.450402 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 10/22] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:02 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1281 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:02.596034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-270dbb21-2822-4372-816c-d7a35724aa93 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:02.597625 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-270dbb21-2822-4372-816c-d7a35724aa93 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:02.623018 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-270dbb21-2822-4372-816c-d7a35724aa93 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:02.627833 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-270dbb21-2822-4372-816c-d7a35724aa93 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:02.629383 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-270dbb21-2822-4372-816c-d7a35724aa93 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:02.630399 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-270dbb21-2822-4372-816c-d7a35724aa93 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:02.636127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-270dbb21-2822-4372-816c-d7a35724aa93 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:02.636127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-270dbb21-2822-4372-816c-d7a35724aa93 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:03.084979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7ef7bed5-62bd-465f-be2c-14716582325c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:03.086424 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7ef7bed5-62bd-465f-be2c-14716582325c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:03.099330 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ef7bed5-62bd-465f-be2c-14716582325c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:03.104650 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ef7bed5-62bd-465f-be2c-14716582325c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:03.106133 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ef7bed5-62bd-465f-be2c-14716582325c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:03.112235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ef7bed5-62bd-465f-be2c-14716582325c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:03.113313 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ef7bed5-62bd-465f-be2c-14716582325c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:03.138309 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ef7bed5-62bd-465f-be2c-14716582325c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:04.860496 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7ef7bed5-62bd-465f-be2c-14716582325c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:04.877021 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7ef7bed5-62bd-465f-be2c-14716582325c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1217 microversion: 2.1 time: 1.800789 Sep 04 16:14:04.877639 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 11/23] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:03 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1217 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:04.898805 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ad4ce87f-4412-41fc-b468-189da6b48be8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:04.903864 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ad4ce87f-4412-41fc-b468-189da6b48be8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:04.914991 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad4ce87f-4412-41fc-b468-189da6b48be8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:04.915904 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad4ce87f-4412-41fc-b468-189da6b48be8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:04.917135 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad4ce87f-4412-41fc-b468-189da6b48be8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:04.918151 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad4ce87f-4412-41fc-b468-189da6b48be8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:04.918798 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad4ce87f-4412-41fc-b468-189da6b48be8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:04.919408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad4ce87f-4412-41fc-b468-189da6b48be8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:05.158413 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ad4ce87f-4412-41fc-b468-189da6b48be8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:05.188464 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ad4ce87f-4412-41fc-b468-189da6b48be8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:05.198636 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ad4ce87f-4412-41fc-b468-189da6b48be8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:05.199722 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ad4ce87f-4412-41fc-b468-189da6b48be8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1333 microversion: 2.20 time: 0.321139 Sep 04 16:14:05.200298 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 12/24] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:04 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1333 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:05.249199 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-270dbb21-2822-4372-816c-d7a35724aa93 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:05.261464 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-270dbb21-2822-4372-816c-d7a35724aa93 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1315 microversion: 2.1 time: 2.668995 Sep 04 16:14:05.280254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 13/25] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:02 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1315 bytes in 2691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:05.757795 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-92aa8884-e0d2-42c8-bb07-da9889591033 req-45472a2e-6cc2-40f3-8dc3-75277a453d36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b95d4253-8af1-41cb-94f9-59b563be0d1d", "tag": "432267bf-359a-4cef-aa7e-120c224fc8fe"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:14:05.793010 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-92aa8884-e0d2-42c8-bb07-da9889591033 req-45472a2e-6cc2-40f3-8dc3-75277a453d36 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:05.794338 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-92aa8884-e0d2-42c8-bb07-da9889591033 req-45472a2e-6cc2-40f3-8dc3-75277a453d36 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:05.798258 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-92aa8884-e0d2-42c8-bb07-da9889591033 req-45472a2e-6cc2-40f3-8dc3-75277a453d36 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:05.876237 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-92aa8884-e0d2-42c8-bb07-da9889591033 req-45472a2e-6cc2-40f3-8dc3-75277a453d36 service nova] Creating event network-changed:432267bf-359a-4cef-aa7e-120c224fc8fe for instance b95d4253-8af1-41cb-94f9-59b563be0d1d on hv-cinder-85236 Sep 04 16:14:05.877652 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-92aa8884-e0d2-42c8-bb07-da9889591033 req-45472a2e-6cc2-40f3-8dc3-75277a453d36 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 04 16:14:05.878286 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-92aa8884-e0d2-42c8-bb07-da9889591033 req-45472a2e-6cc2-40f3-8dc3-75277a453d36 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 04 16:14:05.879616 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-714b64e7-5583-4f33-bd1d-b58030e56c21 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:05.880544 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-714b64e7-5583-4f33-bd1d-b58030e56c21 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:05.882773 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-714b64e7-5583-4f33-bd1d-b58030e56c21 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:05.891698 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-714b64e7-5583-4f33-bd1d-b58030e56c21 None None] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:05.891698 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-714b64e7-5583-4f33-bd1d-b58030e56c21 None None] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:05.891698 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-714b64e7-5583-4f33-bd1d-b58030e56c21 None None] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:05.906737 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f28160ab-7bb8-4d11-94b1-d07ac7bb9c34 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:05.909011 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f28160ab-7bb8-4d11-94b1-d07ac7bb9c34 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:05.928291 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.compute.rpcapi [None req-714b64e7-5583-4f33-bd1d-b58030e56c21 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 04 16:14:05.929205 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-714b64e7-5583-4f33-bd1d-b58030e56c21 None None] Releasing lock "compute-rpcapi-router" {{(pid=121041) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 04 16:14:05.931373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f28160ab-7bb8-4d11-94b1-d07ac7bb9c34 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:05.943462 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f28160ab-7bb8-4d11-94b1-d07ac7bb9c34 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:05.945399 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f28160ab-7bb8-4d11-94b1-d07ac7bb9c34 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:05.946526 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f28160ab-7bb8-4d11-94b1-d07ac7bb9c34 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:05.947482 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f28160ab-7bb8-4d11-94b1-d07ac7bb9c34 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:05.949195 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f28160ab-7bb8-4d11-94b1-d07ac7bb9c34 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:06.003275 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-714b64e7-5583-4f33-bd1d-b58030e56c21 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.801407 Sep 04 16:14:06.004249 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 13/26] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:14:06.025814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1b460bc9-f546-4d6b-aedb-c3df62b690ae tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1498744978", "imageRef": "11a460f6-29b0-46e6-ae98-e53ee2e13520", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1fe4af06-d7bb-4218-9bf8-f19072fe6b17"}], "security_groups": [{"name": "tempest-securitygroup--858258701"}], "key_name": "tempest-keypair-1507779781", "user_data": "}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:14:06.590812 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f28160ab-7bb8-4d11-94b1-d07ac7bb9c34 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:06.623264 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f28160ab-7bb8-4d11-94b1-d07ac7bb9c34 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1279 microversion: 2.1 time: 0.722109 Sep 04 16:14:06.633064 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 14/27] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:05 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1279 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:06.638610 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-229ade93-8aef-4db8-943c-5a07bf949e99 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:06.652397 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-229ade93-8aef-4db8-943c-5a07bf949e99 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:06.680861 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-229ade93-8aef-4db8-943c-5a07bf949e99 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:06.686164 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-229ade93-8aef-4db8-943c-5a07bf949e99 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:06.687212 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-229ade93-8aef-4db8-943c-5a07bf949e99 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:06.695025 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-229ade93-8aef-4db8-943c-5a07bf949e99 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:06.695516 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-229ade93-8aef-4db8-943c-5a07bf949e99 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:06.697418 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-229ade93-8aef-4db8-943c-5a07bf949e99 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:07.122243 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-229ade93-8aef-4db8-943c-5a07bf949e99 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:07.138782 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-229ade93-8aef-4db8-943c-5a07bf949e99 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:07.158715 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-229ade93-8aef-4db8-943c-5a07bf949e99 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:07.160389 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-229ade93-8aef-4db8-943c-5a07bf949e99 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1339 microversion: 2.20 time: 0.525914 Sep 04 16:14:07.163332 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 15/28] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:06 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1339 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:07.193612 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1e2f32d2-2712-43ff-9377-8cdb96684d79 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:07.194295 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1e2f32d2-2712-43ff-9377-8cdb96684d79 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:07.226190 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e2f32d2-2712-43ff-9377-8cdb96684d79 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:07.234405 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e2f32d2-2712-43ff-9377-8cdb96684d79 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:07.235041 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e2f32d2-2712-43ff-9377-8cdb96684d79 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:07.235849 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e2f32d2-2712-43ff-9377-8cdb96684d79 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:07.241368 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e2f32d2-2712-43ff-9377-8cdb96684d79 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:07.242084 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1e2f32d2-2712-43ff-9377-8cdb96684d79 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:07.408187 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-1b460bc9-f546-4d6b-aedb-c3df62b690ae tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] validate_networks() for [('1fe4af06-d7bb-4218-9bf8-f19072fe6b17', None, None, None, None, None)] {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 16:14:08.172092 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1e2f32d2-2712-43ff-9377-8cdb96684d79 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:08.179931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1e2f32d2-2712-43ff-9377-8cdb96684d79 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1315 microversion: 2.1 time: 1.015222 Sep 04 16:14:08.182308 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 16/29] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:07 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1315 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:08.197513 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e4c3cec1-9777-4ba9-9517-4a7c4ec0bb87 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:08.210592 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e4c3cec1-9777-4ba9-9517-4a7c4ec0bb87 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:08.220647 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4c3cec1-9777-4ba9-9517-4a7c4ec0bb87 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:08.221493 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4c3cec1-9777-4ba9-9517-4a7c4ec0bb87 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:08.233945 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4c3cec1-9777-4ba9-9517-4a7c4ec0bb87 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:08.234959 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4c3cec1-9777-4ba9-9517-4a7c4ec0bb87 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:08.235475 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4c3cec1-9777-4ba9-9517-4a7c4ec0bb87 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:08.236138 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4c3cec1-9777-4ba9-9517-4a7c4ec0bb87 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:08.863606 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e4c3cec1-9777-4ba9-9517-4a7c4ec0bb87 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:08.902051 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e4c3cec1-9777-4ba9-9517-4a7c4ec0bb87 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1279 microversion: 2.1 time: 0.686257 Sep 04 16:14:08.902051 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 17/30] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:08 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1279 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:08.902051 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0c72cdf3-1245-4067-96a9-628f58c74c8e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:08.902051 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0c72cdf3-1245-4067-96a9-628f58c74c8e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:08.931648 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c72cdf3-1245-4067-96a9-628f58c74c8e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:08.932024 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c72cdf3-1245-4067-96a9-628f58c74c8e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:08.932475 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c72cdf3-1245-4067-96a9-628f58c74c8e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:08.933198 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c72cdf3-1245-4067-96a9-628f58c74c8e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:08.933693 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c72cdf3-1245-4067-96a9-628f58c74c8e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:08.934118 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c72cdf3-1245-4067-96a9-628f58c74c8e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:09.180867 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0c72cdf3-1245-4067-96a9-628f58c74c8e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:09.180867 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0c72cdf3-1245-4067-96a9-628f58c74c8e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:09.181608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0c72cdf3-1245-4067-96a9-628f58c74c8e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:09.181608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0c72cdf3-1245-4067-96a9-628f58c74c8e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1339 microversion: 2.20 time: 0.282136 Sep 04 16:14:09.181608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 18/31] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:08 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1339 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:09.207164 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7ff67c79-733b-48a6-9566-59d1e6ca1a3c tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:09.208047 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7ff67c79-733b-48a6-9566-59d1e6ca1a3c tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:09.216379 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ff67c79-733b-48a6-9566-59d1e6ca1a3c tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:09.217179 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ff67c79-733b-48a6-9566-59d1e6ca1a3c tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:09.217828 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ff67c79-733b-48a6-9566-59d1e6ca1a3c tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:09.219663 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ff67c79-733b-48a6-9566-59d1e6ca1a3c tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:09.221282 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ff67c79-733b-48a6-9566-59d1e6ca1a3c tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:09.221934 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ff67c79-733b-48a6-9566-59d1e6ca1a3c tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:09.791037 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-1b460bc9-f546-4d6b-aedb-c3df62b690ae tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 16:14:09.791037 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-1b460bc9-f546-4d6b-aedb-c3df62b690ae tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 16:14:09.791037 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-1b460bc9-f546-4d6b-aedb-c3df62b690ae tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 16:14:09.791037 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-1b460bc9-f546-4d6b-aedb-c3df62b690ae tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 16:14:09.791037 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-1b460bc9-f546-4d6b-aedb-c3df62b690ae tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 16:14:09.811798 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b460bc9-f546-4d6b-aedb-c3df62b690ae tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:09.819948 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b460bc9-f546-4d6b-aedb-c3df62b690ae tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:09.819948 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b460bc9-f546-4d6b-aedb-c3df62b690ae tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:09.819948 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b460bc9-f546-4d6b-aedb-c3df62b690ae tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:09.819948 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b460bc9-f546-4d6b-aedb-c3df62b690ae tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:09.820245 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b460bc9-f546-4d6b-aedb-c3df62b690ae tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:09.852816 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-1b460bc9-f546-4d6b-aedb-c3df62b690ae tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Getting quotas for project 1cc5ea4158344d5c8a35bc5783410620. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:14:09.859134 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-1b460bc9-f546-4d6b-aedb-c3df62b690ae tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Getting quotas for user 6e5c22b631df4600b9f920120b67fc67 and project 1cc5ea4158344d5c8a35bc5783410620. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:14:09.863814 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7ff67c79-733b-48a6-9566-59d1e6ca1a3c tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:09.874059 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7ff67c79-733b-48a6-9566-59d1e6ca1a3c tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1315 microversion: 2.1 time: 0.671909 Sep 04 16:14:09.886261 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 19/32] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:09 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1315 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:09.921877 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1b460bc9-f546-4d6b-aedb-c3df62b690ae tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 16:14:09.930492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1b460bc9-f546-4d6b-aedb-c3df62b690ae tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a460f6-29b0-46e6-ae98-e53ee2e13520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 16:14:09.931289 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-39b303dc-1ee6-4bf7-ba14-e843484e757c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:09.932683 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-39b303dc-1ee6-4bf7-ba14-e843484e757c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:09.940783 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39b303dc-1ee6-4bf7-ba14-e843484e757c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:09.942170 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39b303dc-1ee6-4bf7-ba14-e843484e757c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:09.944135 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39b303dc-1ee6-4bf7-ba14-e843484e757c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:09.946458 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39b303dc-1ee6-4bf7-ba14-e843484e757c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:09.947250 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39b303dc-1ee6-4bf7-ba14-e843484e757c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:09.947867 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39b303dc-1ee6-4bf7-ba14-e843484e757c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:10.007486 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:14:10.234686 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1b460bc9-f546-4d6b-aedb-c3df62b690ae tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.227967 Sep 04 16:14:10.239258 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 14/33] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Sep 4 16:14:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 4231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 16:14:10.252470 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-326951c4-75ed-4b1f-83ed-973f15eef8a6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:10.258451 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-326951c4-75ed-4b1f-83ed-973f15eef8a6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:10.278398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-326951c4-75ed-4b1f-83ed-973f15eef8a6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:10.279077 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-326951c4-75ed-4b1f-83ed-973f15eef8a6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:10.279700 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-326951c4-75ed-4b1f-83ed-973f15eef8a6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:10.282857 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-326951c4-75ed-4b1f-83ed-973f15eef8a6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:10.284139 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-326951c4-75ed-4b1f-83ed-973f15eef8a6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:10.284788 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-326951c4-75ed-4b1f-83ed-973f15eef8a6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:10.423197 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-326951c4-75ed-4b1f-83ed-973f15eef8a6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:10.449159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-39b303dc-1ee6-4bf7-ba14-e843484e757c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:10.496680 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-39b303dc-1ee6-4bf7-ba14-e843484e757c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1321 microversion: 2.1 time: 0.568824 Sep 04 16:14:10.502822 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-326951c4-75ed-4b1f-83ed-973f15eef8a6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:10.504225 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 20/34] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:09 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1321 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:10.506863 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-326951c4-75ed-4b1f-83ed-973f15eef8a6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:10.508178 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-326951c4-75ed-4b1f-83ed-973f15eef8a6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1339 microversion: 2.20 time: 0.271064 Sep 04 16:14:10.510239 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 15/35] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:10 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1339 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:10.531751 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4e38d25d-94ab-4d27-b6e4-ba0d2a871b05 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:10.532795 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4e38d25d-94ab-4d27-b6e4-ba0d2a871b05 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:10.801590 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4e38d25d-94ab-4d27-b6e4-ba0d2a871b05 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:10.811837 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4e38d25d-94ab-4d27-b6e4-ba0d2a871b05 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1242 microversion: 2.1 time: 0.305974 Sep 04 16:14:10.831627 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 21/36] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:10 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1242 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:10.898085 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3eb53c0f-d7a2-48e9-a6e7-d100d65e3409 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:10.899353 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3eb53c0f-d7a2-48e9-a6e7-d100d65e3409 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:10.907957 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3eb53c0f-d7a2-48e9-a6e7-d100d65e3409 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:10.910304 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3eb53c0f-d7a2-48e9-a6e7-d100d65e3409 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:10.915621 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3eb53c0f-d7a2-48e9-a6e7-d100d65e3409 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:10.919344 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3eb53c0f-d7a2-48e9-a6e7-d100d65e3409 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:10.923738 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3eb53c0f-d7a2-48e9-a6e7-d100d65e3409 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:10.924689 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3eb53c0f-d7a2-48e9-a6e7-d100d65e3409 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:11.521229 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5a908c4d-8c1c-4d68-9829-8d8d8d96bf6c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:11.522073 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5a908c4d-8c1c-4d68-9829-8d8d8d96bf6c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:11.536573 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a908c4d-8c1c-4d68-9829-8d8d8d96bf6c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:11.542631 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a908c4d-8c1c-4d68-9829-8d8d8d96bf6c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:11.543864 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a908c4d-8c1c-4d68-9829-8d8d8d96bf6c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:11.546331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a908c4d-8c1c-4d68-9829-8d8d8d96bf6c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:11.558561 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a908c4d-8c1c-4d68-9829-8d8d8d96bf6c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:11.562033 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a908c4d-8c1c-4d68-9829-8d8d8d96bf6c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:11.831968 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3eb53c0f-d7a2-48e9-a6e7-d100d65e3409 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:11.860429 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3eb53c0f-d7a2-48e9-a6e7-d100d65e3409 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1315 microversion: 2.1 time: 0.965713 Sep 04 16:14:11.883441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 16/37] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:10 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1315 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:11.890148 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e50905da-7a4e-4bb0-b807-656f249bc09d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:11.891034 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e50905da-7a4e-4bb0-b807-656f249bc09d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:11.898070 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e50905da-7a4e-4bb0-b807-656f249bc09d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:11.899139 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e50905da-7a4e-4bb0-b807-656f249bc09d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:11.900509 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e50905da-7a4e-4bb0-b807-656f249bc09d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:11.901456 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e50905da-7a4e-4bb0-b807-656f249bc09d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:11.902128 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e50905da-7a4e-4bb0-b807-656f249bc09d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:11.902748 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e50905da-7a4e-4bb0-b807-656f249bc09d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:12.134633 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e50905da-7a4e-4bb0-b807-656f249bc09d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:12.175106 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e50905da-7a4e-4bb0-b807-656f249bc09d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:12.180365 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e50905da-7a4e-4bb0-b807-656f249bc09d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:12.190263 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e50905da-7a4e-4bb0-b807-656f249bc09d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1339 microversion: 2.20 time: 0.304206 Sep 04 16:14:12.191898 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 17/38] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:11 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1339 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:12.199764 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-89d09206-0828-4a7a-8603-50bf39979ffc tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:12.201124 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-89d09206-0828-4a7a-8603-50bf39979ffc tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:12.208878 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89d09206-0828-4a7a-8603-50bf39979ffc tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:12.209747 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89d09206-0828-4a7a-8603-50bf39979ffc tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:12.210350 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89d09206-0828-4a7a-8603-50bf39979ffc tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:12.211190 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89d09206-0828-4a7a-8603-50bf39979ffc tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:12.211926 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89d09206-0828-4a7a-8603-50bf39979ffc tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:12.212492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89d09206-0828-4a7a-8603-50bf39979ffc tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:12.396112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5a908c4d-8c1c-4d68-9829-8d8d8d96bf6c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:12.404733 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5a908c4d-8c1c-4d68-9829-8d8d8d96bf6c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1321 microversion: 2.1 time: 0.887757 Sep 04 16:14:12.417531 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 22/39] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:11 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1321 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:12.433853 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-89d09206-0828-4a7a-8603-50bf39979ffc tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:12.443645 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-89d09206-0828-4a7a-8603-50bf39979ffc tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1246 microversion: 2.1 time: 0.248963 Sep 04 16:14:12.444442 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 18/40] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:12 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1246 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:12.893297 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-29b00fb0-6f56-4bd4-a703-07f2d56a131d tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:12.894145 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-29b00fb0-6f56-4bd4-a703-07f2d56a131d tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:12.900164 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29b00fb0-6f56-4bd4-a703-07f2d56a131d tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:12.900792 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29b00fb0-6f56-4bd4-a703-07f2d56a131d tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:12.901067 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29b00fb0-6f56-4bd4-a703-07f2d56a131d tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:12.902829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29b00fb0-6f56-4bd4-a703-07f2d56a131d tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:12.903320 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29b00fb0-6f56-4bd4-a703-07f2d56a131d tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:12.903748 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29b00fb0-6f56-4bd4-a703-07f2d56a131d tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:13.036959 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-188cb938-2d71-4ffd-8101-5604e119875c req-ae739feb-9320-4f39-a469-14ee7c061dcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee1afbcb-161b-4255-af5d-7aa20d2bf66f", "tag": "9b25d6f3-c217-4ae7-8acc-96e8367604e3"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:14:13.050342 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-188cb938-2d71-4ffd-8101-5604e119875c req-ae739feb-9320-4f39-a469-14ee7c061dcb service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:13.050961 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-188cb938-2d71-4ffd-8101-5604e119875c req-ae739feb-9320-4f39-a469-14ee7c061dcb service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:13.051491 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-188cb938-2d71-4ffd-8101-5604e119875c req-ae739feb-9320-4f39-a469-14ee7c061dcb service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:13.072152 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-188cb938-2d71-4ffd-8101-5604e119875c req-ae739feb-9320-4f39-a469-14ee7c061dcb service nova] Creating event network-changed:9b25d6f3-c217-4ae7-8acc-96e8367604e3 for instance ee1afbcb-161b-4255-af5d-7aa20d2bf66f on hv-cinder-85236 Sep 04 16:14:13.072841 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-188cb938-2d71-4ffd-8101-5604e119875c req-ae739feb-9320-4f39-a469-14ee7c061dcb service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121040) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 04 16:14:13.073333 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-188cb938-2d71-4ffd-8101-5604e119875c req-ae739feb-9320-4f39-a469-14ee7c061dcb service nova] Acquired lock "compute-rpcapi-router" {{(pid=121040) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 04 16:14:13.074528 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a646159-b0ea-4349-9ec5-d902dd45e365 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:13.084897 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a646159-b0ea-4349-9ec5-d902dd45e365 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:13.086795 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a646159-b0ea-4349-9ec5-d902dd45e365 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:13.090258 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a646159-b0ea-4349-9ec5-d902dd45e365 None None] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:13.090916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a646159-b0ea-4349-9ec5-d902dd45e365 None None] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:13.091358 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a646159-b0ea-4349-9ec5-d902dd45e365 None None] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:13.107928 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.compute.rpcapi [None req-8a646159-b0ea-4349-9ec5-d902dd45e365 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 04 16:14:13.110195 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a646159-b0ea-4349-9ec5-d902dd45e365 None None] Releasing lock "compute-rpcapi-router" {{(pid=121040) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 04 16:14:13.130935 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8a646159-b0ea-4349-9ec5-d902dd45e365 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.364647 Sep 04 16:14:13.132658 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 23/41] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:14:13.148630 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-29b00fb0-6f56-4bd4-a703-07f2d56a131d tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:13.176542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-29b00fb0-6f56-4bd4-a703-07f2d56a131d tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1315 microversion: 2.1 time: 0.274876 Sep 04 16:14:13.176542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 19/42] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:12 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:13.228509 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b6f0464c-56f9-489b-9580-5df62814ed34 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:13.229218 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b6f0464c-56f9-489b-9580-5df62814ed34 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:13.235759 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6f0464c-56f9-489b-9580-5df62814ed34 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:13.236229 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6f0464c-56f9-489b-9580-5df62814ed34 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:13.236652 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6f0464c-56f9-489b-9580-5df62814ed34 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:13.237323 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6f0464c-56f9-489b-9580-5df62814ed34 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:13.237808 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6f0464c-56f9-489b-9580-5df62814ed34 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:13.238224 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b6f0464c-56f9-489b-9580-5df62814ed34 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:13.395824 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b6f0464c-56f9-489b-9580-5df62814ed34 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:13.403782 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b6f0464c-56f9-489b-9580-5df62814ed34 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:13.405247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b6f0464c-56f9-489b-9580-5df62814ed34 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:13.406460 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b6f0464c-56f9-489b-9580-5df62814ed34 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1407 microversion: 2.20 time: 0.182212 Sep 04 16:14:13.407158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 24/43] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:13 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:13.444870 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ae4450fd-aef7-4ac9-995e-b163f8216f22 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:13.447031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ae4450fd-aef7-4ac9-995e-b163f8216f22 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:13.452741 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ae4450fd-aef7-4ac9-995e-b163f8216f22 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:13.453326 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ae4450fd-aef7-4ac9-995e-b163f8216f22 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:13.453797 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ae4450fd-aef7-4ac9-995e-b163f8216f22 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:13.454502 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ae4450fd-aef7-4ac9-995e-b163f8216f22 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:13.454987 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ae4450fd-aef7-4ac9-995e-b163f8216f22 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:13.455415 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ae4450fd-aef7-4ac9-995e-b163f8216f22 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:13.468209 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cbcff177-a0d0-4b2b-92dc-d54008886042 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:13.469792 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cbcff177-a0d0-4b2b-92dc-d54008886042 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:13.476119 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbcff177-a0d0-4b2b-92dc-d54008886042 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:13.476826 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbcff177-a0d0-4b2b-92dc-d54008886042 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:13.477419 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbcff177-a0d0-4b2b-92dc-d54008886042 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:13.478155 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbcff177-a0d0-4b2b-92dc-d54008886042 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:13.478609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbcff177-a0d0-4b2b-92dc-d54008886042 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:13.479025 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cbcff177-a0d0-4b2b-92dc-d54008886042 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:13.567529 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-cbcff177-a0d0-4b2b-92dc-d54008886042 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:13.578932 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cbcff177-a0d0-4b2b-92dc-d54008886042 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1238 microversion: 2.1 time: 0.114466 Sep 04 16:14:13.579772 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 25/44] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:13 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1238 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:13.652422 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ae4450fd-aef7-4ac9-995e-b163f8216f22 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:13.663320 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ae4450fd-aef7-4ac9-995e-b163f8216f22 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1321 microversion: 2.1 time: 0.222480 Sep 04 16:14:13.666694 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 20/45] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:13 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:14.188983 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f4d86f01-e9bc-4dc4-bc3c-5e49c33a0d62 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:14.190167 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f4d86f01-e9bc-4dc4-bc3c-5e49c33a0d62 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:14.195436 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4d86f01-e9bc-4dc4-bc3c-5e49c33a0d62 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:14.195911 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4d86f01-e9bc-4dc4-bc3c-5e49c33a0d62 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:14.196339 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4d86f01-e9bc-4dc4-bc3c-5e49c33a0d62 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:14.197014 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4d86f01-e9bc-4dc4-bc3c-5e49c33a0d62 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:14.197458 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4d86f01-e9bc-4dc4-bc3c-5e49c33a0d62 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:14.197940 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4d86f01-e9bc-4dc4-bc3c-5e49c33a0d62 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:14.331650 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f4d86f01-e9bc-4dc4-bc3c-5e49c33a0d62 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:14.339549 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f4d86f01-e9bc-4dc4-bc3c-5e49c33a0d62 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1315 microversion: 2.1 time: 0.154321 Sep 04 16:14:14.340178 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 26/46] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:14 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:14.430912 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-94b54f1b-ae32-4b23-b3e7-87a51d21fea7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:14.432243 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-94b54f1b-ae32-4b23-b3e7-87a51d21fea7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:14.435256 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:14:14.438912 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-94b54f1b-ae32-4b23-b3e7-87a51d21fea7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:14.439389 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-94b54f1b-ae32-4b23-b3e7-87a51d21fea7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:14.439846 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-94b54f1b-ae32-4b23-b3e7-87a51d21fea7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:14.440539 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-94b54f1b-ae32-4b23-b3e7-87a51d21fea7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:14.440983 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-94b54f1b-ae32-4b23-b3e7-87a51d21fea7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:14.441395 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-94b54f1b-ae32-4b23-b3e7-87a51d21fea7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:14.593955 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-94b54f1b-ae32-4b23-b3e7-87a51d21fea7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:14.603510 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9c41f764-18e0-422c-8d29-07c1f4f7bf12 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:14.604131 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9c41f764-18e0-422c-8d29-07c1f4f7bf12 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:14.610064 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-94b54f1b-ae32-4b23-b3e7-87a51d21fea7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:14.610539 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-94b54f1b-ae32-4b23-b3e7-87a51d21fea7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:14.611916 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-94b54f1b-ae32-4b23-b3e7-87a51d21fea7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1407 microversion: 2.20 time: 0.184877 Sep 04 16:14:14.612495 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 21/47] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:14 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:14.614739 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c41f764-18e0-422c-8d29-07c1f4f7bf12 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:14.615731 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c41f764-18e0-422c-8d29-07c1f4f7bf12 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:14.616324 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c41f764-18e0-422c-8d29-07c1f4f7bf12 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:14.617457 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c41f764-18e0-422c-8d29-07c1f4f7bf12 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:14.618631 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c41f764-18e0-422c-8d29-07c1f4f7bf12 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:14.619215 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c41f764-18e0-422c-8d29-07c1f4f7bf12 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:14.687151 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cfb11623-1805-43a1-ae30-4cfc65105bb4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:14.688920 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cfb11623-1805-43a1-ae30-4cfc65105bb4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:14.694716 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-9c41f764-18e0-422c-8d29-07c1f4f7bf12 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:14.696017 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cfb11623-1805-43a1-ae30-4cfc65105bb4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:14.699059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cfb11623-1805-43a1-ae30-4cfc65105bb4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:14.699059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cfb11623-1805-43a1-ae30-4cfc65105bb4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:14.699059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cfb11623-1805-43a1-ae30-4cfc65105bb4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:14.699398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cfb11623-1805-43a1-ae30-4cfc65105bb4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:14.699802 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cfb11623-1805-43a1-ae30-4cfc65105bb4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:14.704672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9c41f764-18e0-422c-8d29-07c1f4f7bf12 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1238 microversion: 2.1 time: 0.104970 Sep 04 16:14:14.705449 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 27/48] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:14 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1238 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:14.837158 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-cfb11623-1805-43a1-ae30-4cfc65105bb4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:14.845268 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cfb11623-1805-43a1-ae30-4cfc65105bb4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1321 microversion: 2.1 time: 0.162019 Sep 04 16:14:14.845933 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 22/49] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:14 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:15.157100 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-980f3758-16eb-4e2d-bc20-48504126ae63 req-f3ee9757-a825-4617-b0ff-0451ca956a30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9df07895-c9cb-4cee-93e7-1cafff31b091", "tag": "dab8e735-7496-45d4-bc92-b047426a274b"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:14:15.176462 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-980f3758-16eb-4e2d-bc20-48504126ae63 req-f3ee9757-a825-4617-b0ff-0451ca956a30 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:15.176939 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-980f3758-16eb-4e2d-bc20-48504126ae63 req-f3ee9757-a825-4617-b0ff-0451ca956a30 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:15.184208 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-980f3758-16eb-4e2d-bc20-48504126ae63 req-f3ee9757-a825-4617-b0ff-0451ca956a30 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:15.202759 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-980f3758-16eb-4e2d-bc20-48504126ae63 req-f3ee9757-a825-4617-b0ff-0451ca956a30 service nova] Creating event network-changed:dab8e735-7496-45d4-bc92-b047426a274b for instance 9df07895-c9cb-4cee-93e7-1cafff31b091 on hv-cinder-85236 Sep 04 16:14:15.208531 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-980f3758-16eb-4e2d-bc20-48504126ae63 req-f3ee9757-a825-4617-b0ff-0451ca956a30 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056603 Sep 04 16:14:15.209464 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 28/50] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:14:15.364086 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-bdd76731-e792-4559-a361-4b636bc28597 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:15.364881 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-bdd76731-e792-4559-a361-4b636bc28597 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:15.377171 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bdd76731-e792-4559-a361-4b636bc28597 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:15.378974 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bdd76731-e792-4559-a361-4b636bc28597 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:15.380115 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bdd76731-e792-4559-a361-4b636bc28597 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:15.385544 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bdd76731-e792-4559-a361-4b636bc28597 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:15.386562 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bdd76731-e792-4559-a361-4b636bc28597 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:15.387792 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bdd76731-e792-4559-a361-4b636bc28597 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:15.591803 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bdd76731-e792-4559-a361-4b636bc28597 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:15.602057 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-bdd76731-e792-4559-a361-4b636bc28597 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1315 microversion: 2.1 time: 0.242556 Sep 04 16:14:15.602632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 23/51] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:15 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:15.648476 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c5213c54-c0ae-4e75-9963-968732b6f0c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:15.655836 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c5213c54-c0ae-4e75-9963-968732b6f0c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:15.661615 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:14:15.675390 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5213c54-c0ae-4e75-9963-968732b6f0c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:15.676164 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5213c54-c0ae-4e75-9963-968732b6f0c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:15.677598 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5213c54-c0ae-4e75-9963-968732b6f0c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:15.680274 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5213c54-c0ae-4e75-9963-968732b6f0c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:15.680757 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5213c54-c0ae-4e75-9963-968732b6f0c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:15.681186 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5213c54-c0ae-4e75-9963-968732b6f0c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:15.728899 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-683e23bc-0371-421a-b001-ce2107bb75f3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:15.730312 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-683e23bc-0371-421a-b001-ce2107bb75f3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:15.739126 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-683e23bc-0371-421a-b001-ce2107bb75f3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:15.739748 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-683e23bc-0371-421a-b001-ce2107bb75f3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:15.740218 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-683e23bc-0371-421a-b001-ce2107bb75f3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:15.741290 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-683e23bc-0371-421a-b001-ce2107bb75f3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:15.741880 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-683e23bc-0371-421a-b001-ce2107bb75f3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:15.742510 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-683e23bc-0371-421a-b001-ce2107bb75f3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:15.857542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-683e23bc-0371-421a-b001-ce2107bb75f3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:15.868425 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-683e23bc-0371-421a-b001-ce2107bb75f3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1238 microversion: 2.1 time: 0.143918 Sep 04 16:14:15.875203 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 24/52] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:15 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1238 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:15.880151 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c2ade9a7-ffbf-4b23-8d1a-f0690ab4151a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:15.880900 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c2ade9a7-ffbf-4b23-8d1a-f0690ab4151a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:15.888459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c2ade9a7-ffbf-4b23-8d1a-f0690ab4151a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:15.895590 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c2ade9a7-ffbf-4b23-8d1a-f0690ab4151a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:15.896284 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c2ade9a7-ffbf-4b23-8d1a-f0690ab4151a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:15.897543 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c2ade9a7-ffbf-4b23-8d1a-f0690ab4151a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:15.902077 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c2ade9a7-ffbf-4b23-8d1a-f0690ab4151a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:15.902880 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c2ade9a7-ffbf-4b23-8d1a-f0690ab4151a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:15.908638 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c5213c54-c0ae-4e75-9963-968732b6f0c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:15.917786 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c5213c54-c0ae-4e75-9963-968732b6f0c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:15.919619 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c5213c54-c0ae-4e75-9963-968732b6f0c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:15.920958 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c5213c54-c0ae-4e75-9963-968732b6f0c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1407 microversion: 2.20 time: 0.277575 Sep 04 16:14:15.921788 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 29/53] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:15 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:14:16.076611 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c2ade9a7-ffbf-4b23-8d1a-f0690ab4151a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:16.084544 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c2ade9a7-ffbf-4b23-8d1a-f0690ab4151a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1321 microversion: 2.1 time: 0.208072 Sep 04 16:14:16.085121 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 25/54] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:15 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:16.625945 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e6003c44-c3ab-4ce7-bffe-1f26ff51ecf9 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:16.626544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e6003c44-c3ab-4ce7-bffe-1f26ff51ecf9 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:16.635362 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e6003c44-c3ab-4ce7-bffe-1f26ff51ecf9 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:16.640020 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e6003c44-c3ab-4ce7-bffe-1f26ff51ecf9 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:16.641822 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e6003c44-c3ab-4ce7-bffe-1f26ff51ecf9 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:16.643233 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e6003c44-c3ab-4ce7-bffe-1f26ff51ecf9 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:16.644664 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e6003c44-c3ab-4ce7-bffe-1f26ff51ecf9 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:16.648121 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e6003c44-c3ab-4ce7-bffe-1f26ff51ecf9 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:16.655980 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:14:16.867401 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e6003c44-c3ab-4ce7-bffe-1f26ff51ecf9 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:16.876148 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e6003c44-c3ab-4ce7-bffe-1f26ff51ecf9 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1315 microversion: 2.1 time: 0.254710 Sep 04 16:14:16.877268 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 30/55] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:16 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:16.891833 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c2c0dc4d-f133-4e13-a8d8-c8b67970554d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:16.892959 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c2c0dc4d-f133-4e13-a8d8-c8b67970554d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:16.898966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c2c0dc4d-f133-4e13-a8d8-c8b67970554d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:16.900802 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c2c0dc4d-f133-4e13-a8d8-c8b67970554d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:16.901492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c2c0dc4d-f133-4e13-a8d8-c8b67970554d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:16.902490 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c2c0dc4d-f133-4e13-a8d8-c8b67970554d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:16.903089 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c2c0dc4d-f133-4e13-a8d8-c8b67970554d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:16.903669 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c2c0dc4d-f133-4e13-a8d8-c8b67970554d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:16.930907 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:14:16.947409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4254b2da-ad5c-4d39-bec4-11df5bbb7d21 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:16.948378 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4254b2da-ad5c-4d39-bec4-11df5bbb7d21 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:16.961847 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4254b2da-ad5c-4d39-bec4-11df5bbb7d21 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:16.964903 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4254b2da-ad5c-4d39-bec4-11df5bbb7d21 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:16.964903 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4254b2da-ad5c-4d39-bec4-11df5bbb7d21 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:16.964903 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4254b2da-ad5c-4d39-bec4-11df5bbb7d21 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:16.964903 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4254b2da-ad5c-4d39-bec4-11df5bbb7d21 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:16.965327 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4254b2da-ad5c-4d39-bec4-11df5bbb7d21 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:16.996094 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c2c0dc4d-f133-4e13-a8d8-c8b67970554d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:17.011138 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c2c0dc4d-f133-4e13-a8d8-c8b67970554d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1294 microversion: 2.1 time: 0.123278 Sep 04 16:14:17.017722 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 26/56] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:16 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1294 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:17.129277 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-486db376-af23-4820-8370-8265b0409533 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:17.130141 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-486db376-af23-4820-8370-8265b0409533 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:17.137008 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-486db376-af23-4820-8370-8265b0409533 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:17.137767 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-486db376-af23-4820-8370-8265b0409533 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:17.138356 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-486db376-af23-4820-8370-8265b0409533 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:17.139208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-486db376-af23-4820-8370-8265b0409533 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:17.139946 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-486db376-af23-4820-8370-8265b0409533 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:17.140823 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-486db376-af23-4820-8370-8265b0409533 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:17.271010 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4254b2da-ad5c-4d39-bec4-11df5bbb7d21 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:17.279206 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4254b2da-ad5c-4d39-bec4-11df5bbb7d21 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:17.280821 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4254b2da-ad5c-4d39-bec4-11df5bbb7d21 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:17.282959 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4254b2da-ad5c-4d39-bec4-11df5bbb7d21 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1407 microversion: 2.20 time: 0.339385 Sep 04 16:14:17.283744 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 31/57] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:16 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1407 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:17.379929 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-486db376-af23-4820-8370-8265b0409533 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:17.389928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-486db376-af23-4820-8370-8265b0409533 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1321 microversion: 2.1 time: 0.274637 Sep 04 16:14:17.391954 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 27/58] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:17 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:17.863280 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-625bb97a-0b80-4624-9fb6-1d5e6aae2801 req-be59b625-96a9-480c-944f-ebf745a3b5ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25192300-f22a-4b50-b390-17236f961eb5", "tag": "ea45359b-6df0-4bcb-9182-26e4cca9bdd6"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:14:17.874610 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-625bb97a-0b80-4624-9fb6-1d5e6aae2801 req-be59b625-96a9-480c-944f-ebf745a3b5ad service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:17.876095 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-625bb97a-0b80-4624-9fb6-1d5e6aae2801 req-be59b625-96a9-480c-944f-ebf745a3b5ad service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:17.876726 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-625bb97a-0b80-4624-9fb6-1d5e6aae2801 req-be59b625-96a9-480c-944f-ebf745a3b5ad service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:17.900610 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6ac9f6e6-4750-40ef-9e03-8a7f2345d441 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:17.902958 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6ac9f6e6-4750-40ef-9e03-8a7f2345d441 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:17.903090 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-625bb97a-0b80-4624-9fb6-1d5e6aae2801 req-be59b625-96a9-480c-944f-ebf745a3b5ad service nova] Creating event network-changed:ea45359b-6df0-4bcb-9182-26e4cca9bdd6 for instance 25192300-f22a-4b50-b390-17236f961eb5 on hv-cinder-85236 Sep 04 16:14:17.910920 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-625bb97a-0b80-4624-9fb6-1d5e6aae2801 req-be59b625-96a9-480c-944f-ebf745a3b5ad service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053583 Sep 04 16:14:17.911880 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 32/59] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:14:17.915925 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6ac9f6e6-4750-40ef-9e03-8a7f2345d441 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:17.916416 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6ac9f6e6-4750-40ef-9e03-8a7f2345d441 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:17.916844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6ac9f6e6-4750-40ef-9e03-8a7f2345d441 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:17.917538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6ac9f6e6-4750-40ef-9e03-8a7f2345d441 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:17.918027 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6ac9f6e6-4750-40ef-9e03-8a7f2345d441 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:17.918443 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6ac9f6e6-4750-40ef-9e03-8a7f2345d441 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:18.038806 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-77b1901f-5742-4460-afe0-313de2a1c4db tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:18.039880 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-77b1901f-5742-4460-afe0-313de2a1c4db tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:18.048171 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77b1901f-5742-4460-afe0-313de2a1c4db tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:18.048884 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77b1901f-5742-4460-afe0-313de2a1c4db tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:18.049480 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77b1901f-5742-4460-afe0-313de2a1c4db tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:18.050402 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77b1901f-5742-4460-afe0-313de2a1c4db tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:18.050961 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77b1901f-5742-4460-afe0-313de2a1c4db tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:18.051488 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-77b1901f-5742-4460-afe0-313de2a1c4db tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:18.129104 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-77b1901f-5742-4460-afe0-313de2a1c4db tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:18.137638 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6ac9f6e6-4750-40ef-9e03-8a7f2345d441 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:18.137865 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-77b1901f-5742-4460-afe0-313de2a1c4db tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1294 microversion: 2.1 time: 0.105037 Sep 04 16:14:18.138523 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 33/60] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:18 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1294 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:18.145959 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6ac9f6e6-4750-40ef-9e03-8a7f2345d441 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1315 microversion: 2.1 time: 0.249804 Sep 04 16:14:18.146522 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 28/61] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:17 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:18.308223 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b14ec5a2-76c9-4fd7-97ae-2d656de7b4ff tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:18.308951 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b14ec5a2-76c9-4fd7-97ae-2d656de7b4ff tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:18.315186 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b14ec5a2-76c9-4fd7-97ae-2d656de7b4ff tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:18.316100 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b14ec5a2-76c9-4fd7-97ae-2d656de7b4ff tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:18.316100 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b14ec5a2-76c9-4fd7-97ae-2d656de7b4ff tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:18.316736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b14ec5a2-76c9-4fd7-97ae-2d656de7b4ff tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:18.317185 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b14ec5a2-76c9-4fd7-97ae-2d656de7b4ff tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:18.317619 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b14ec5a2-76c9-4fd7-97ae-2d656de7b4ff tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:18.417965 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2ba294dd-a2ee-43e9-9a48-fb73085892ca tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:18.418945 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2ba294dd-a2ee-43e9-9a48-fb73085892ca tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:18.425155 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2ba294dd-a2ee-43e9-9a48-fb73085892ca tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:18.425852 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2ba294dd-a2ee-43e9-9a48-fb73085892ca tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:18.426446 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2ba294dd-a2ee-43e9-9a48-fb73085892ca tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:18.427321 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2ba294dd-a2ee-43e9-9a48-fb73085892ca tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:18.427778 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2ba294dd-a2ee-43e9-9a48-fb73085892ca tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:18.428358 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2ba294dd-a2ee-43e9-9a48-fb73085892ca tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:18.486119 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b14ec5a2-76c9-4fd7-97ae-2d656de7b4ff tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:18.499494 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b14ec5a2-76c9-4fd7-97ae-2d656de7b4ff tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:18.502982 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b14ec5a2-76c9-4fd7-97ae-2d656de7b4ff tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:18.517697 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b14ec5a2-76c9-4fd7-97ae-2d656de7b4ff tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1407 microversion: 2.20 time: 0.199942 Sep 04 16:14:18.517697 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 34/62] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:18 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:18.595608 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2ba294dd-a2ee-43e9-9a48-fb73085892ca tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:18.605585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2ba294dd-a2ee-43e9-9a48-fb73085892ca tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1321 microversion: 2.1 time: 0.191391 Sep 04 16:14:18.606422 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 29/63] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:18 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:19.162922 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-67122fba-5a43-41d5-bdf9-050b369b7a0e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:19.162922 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-67122fba-5a43-41d5-bdf9-050b369b7a0e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:19.168098 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d7659a2a-68c2-44db-902b-c8412f6c5831 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:19.168713 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d7659a2a-68c2-44db-902b-c8412f6c5831 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:19.177079 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d7659a2a-68c2-44db-902b-c8412f6c5831 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:19.177808 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d7659a2a-68c2-44db-902b-c8412f6c5831 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:19.178709 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d7659a2a-68c2-44db-902b-c8412f6c5831 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:19.179551 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d7659a2a-68c2-44db-902b-c8412f6c5831 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:19.180002 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d7659a2a-68c2-44db-902b-c8412f6c5831 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:19.180578 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d7659a2a-68c2-44db-902b-c8412f6c5831 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:19.186118 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67122fba-5a43-41d5-bdf9-050b369b7a0e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:19.186605 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67122fba-5a43-41d5-bdf9-050b369b7a0e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:19.187035 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67122fba-5a43-41d5-bdf9-050b369b7a0e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:19.188155 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67122fba-5a43-41d5-bdf9-050b369b7a0e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:19.188691 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67122fba-5a43-41d5-bdf9-050b369b7a0e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:19.189119 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67122fba-5a43-41d5-bdf9-050b369b7a0e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:19.308851 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-67122fba-5a43-41d5-bdf9-050b369b7a0e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:19.320514 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-67122fba-5a43-41d5-bdf9-050b369b7a0e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1294 microversion: 2.1 time: 0.159536 Sep 04 16:14:19.320514 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 35/64] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:19 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1294 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:19.396744 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d7659a2a-68c2-44db-902b-c8412f6c5831 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:19.409946 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d7659a2a-68c2-44db-902b-c8412f6c5831 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1315 microversion: 2.1 time: 0.245380 Sep 04 16:14:19.410660 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 30/65] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:19 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:19.530159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-695ddf23-6e94-46f7-a5f6-68d7193c7a1d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:19.530796 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-695ddf23-6e94-46f7-a5f6-68d7193c7a1d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:19.536849 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-695ddf23-6e94-46f7-a5f6-68d7193c7a1d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:19.537363 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-695ddf23-6e94-46f7-a5f6-68d7193c7a1d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:19.537821 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-695ddf23-6e94-46f7-a5f6-68d7193c7a1d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:19.538512 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-695ddf23-6e94-46f7-a5f6-68d7193c7a1d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:19.538964 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-695ddf23-6e94-46f7-a5f6-68d7193c7a1d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:19.539390 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-695ddf23-6e94-46f7-a5f6-68d7193c7a1d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:19.629327 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-701ca7d1-5972-4ac7-acf5-7d0718e7bc01 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:19.629960 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-701ca7d1-5972-4ac7-acf5-7d0718e7bc01 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:19.641540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-701ca7d1-5972-4ac7-acf5-7d0718e7bc01 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:19.642080 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-701ca7d1-5972-4ac7-acf5-7d0718e7bc01 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:19.642511 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-701ca7d1-5972-4ac7-acf5-7d0718e7bc01 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:19.645746 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-701ca7d1-5972-4ac7-acf5-7d0718e7bc01 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:19.646222 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-701ca7d1-5972-4ac7-acf5-7d0718e7bc01 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:19.646659 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-701ca7d1-5972-4ac7-acf5-7d0718e7bc01 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:19.688222 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-695ddf23-6e94-46f7-a5f6-68d7193c7a1d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:19.701447 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-695ddf23-6e94-46f7-a5f6-68d7193c7a1d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:19.708878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-695ddf23-6e94-46f7-a5f6-68d7193c7a1d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:19.710339 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-695ddf23-6e94-46f7-a5f6-68d7193c7a1d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1407 microversion: 2.20 time: 0.184235 Sep 04 16:14:19.711065 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 36/66] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:19 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:19.830375 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=10 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:14:19.897785 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=30 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:14:19.909739 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-701ca7d1-5972-4ac7-acf5-7d0718e7bc01 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:19.918160 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-701ca7d1-5972-4ac7-acf5-7d0718e7bc01 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1321 microversion: 2.1 time: 0.293383 Sep 04 16:14:19.918738 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 31/67] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:19 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:20.340062 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-392d4fb0-f08e-4714-828a-beb3202278ba tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:20.341076 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-392d4fb0-f08e-4714-828a-beb3202278ba tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:20.348290 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-392d4fb0-f08e-4714-828a-beb3202278ba tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:20.348785 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-392d4fb0-f08e-4714-828a-beb3202278ba tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:20.349868 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-392d4fb0-f08e-4714-828a-beb3202278ba tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:20.350877 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-392d4fb0-f08e-4714-828a-beb3202278ba tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:20.351408 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-392d4fb0-f08e-4714-828a-beb3202278ba tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:20.351842 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-392d4fb0-f08e-4714-828a-beb3202278ba tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:20.423576 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-392d4fb0-f08e-4714-828a-beb3202278ba tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:20.431508 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-392d4fb0-f08e-4714-828a-beb3202278ba tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1294 microversion: 2.1 time: 0.095069 Sep 04 16:14:20.436447 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-005092f9-7983-4644-91f2-6b00f22d280b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:20.436447 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-005092f9-7983-4644-91f2-6b00f22d280b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:20.437768 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 37/68] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:20 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1294 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:20.444689 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-005092f9-7983-4644-91f2-6b00f22d280b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:20.445942 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-005092f9-7983-4644-91f2-6b00f22d280b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:20.446449 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-005092f9-7983-4644-91f2-6b00f22d280b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:20.447214 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-005092f9-7983-4644-91f2-6b00f22d280b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:20.447672 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-005092f9-7983-4644-91f2-6b00f22d280b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:20.448093 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-005092f9-7983-4644-91f2-6b00f22d280b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:20.598683 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-005092f9-7983-4644-91f2-6b00f22d280b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:20.607405 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-005092f9-7983-4644-91f2-6b00f22d280b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1315 microversion: 2.1 time: 0.177445 Sep 04 16:14:20.608064 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 32/69] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:20 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:20.738327 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-19db02d6-4128-484a-9f94-3d33292863cf tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:20.738857 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-19db02d6-4128-484a-9f94-3d33292863cf tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:20.746163 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19db02d6-4128-484a-9f94-3d33292863cf tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:20.746732 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19db02d6-4128-484a-9f94-3d33292863cf tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:20.747232 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19db02d6-4128-484a-9f94-3d33292863cf tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:20.748002 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19db02d6-4128-484a-9f94-3d33292863cf tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:20.748543 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19db02d6-4128-484a-9f94-3d33292863cf tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:20.749118 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-19db02d6-4128-484a-9f94-3d33292863cf tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:20.807910 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=26 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:14:20.950830 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-49c0940e-2bb3-40f4-893a-bbca93f934e1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:20.957989 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-49c0940e-2bb3-40f4-893a-bbca93f934e1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:20.981098 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-49c0940e-2bb3-40f4-893a-bbca93f934e1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:20.981762 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-49c0940e-2bb3-40f4-893a-bbca93f934e1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:20.982250 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-49c0940e-2bb3-40f4-893a-bbca93f934e1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:20.983024 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-49c0940e-2bb3-40f4-893a-bbca93f934e1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:20.983542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-49c0940e-2bb3-40f4-893a-bbca93f934e1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:20.984674 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-49c0940e-2bb3-40f4-893a-bbca93f934e1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:21.210537 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-19db02d6-4128-484a-9f94-3d33292863cf tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:21.226848 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-19db02d6-4128-484a-9f94-3d33292863cf tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:21.228278 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-19db02d6-4128-484a-9f94-3d33292863cf tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:21.229405 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-19db02d6-4128-484a-9f94-3d33292863cf tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1407 microversion: 2.20 time: 0.495947 Sep 04 16:14:21.249174 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 38/70] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:20 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1407 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:21.456760 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-41462d9c-7f7e-4cc6-9ec9-757d6acc5902 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:21.457383 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-41462d9c-7f7e-4cc6-9ec9-757d6acc5902 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:21.476386 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41462d9c-7f7e-4cc6-9ec9-757d6acc5902 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:21.478877 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41462d9c-7f7e-4cc6-9ec9-757d6acc5902 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:21.478877 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41462d9c-7f7e-4cc6-9ec9-757d6acc5902 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:21.478877 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41462d9c-7f7e-4cc6-9ec9-757d6acc5902 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:21.478877 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41462d9c-7f7e-4cc6-9ec9-757d6acc5902 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:21.479318 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41462d9c-7f7e-4cc6-9ec9-757d6acc5902 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:21.912244 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-41462d9c-7f7e-4cc6-9ec9-757d6acc5902 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:21.920536 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-41462d9c-7f7e-4cc6-9ec9-757d6acc5902 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1312 microversion: 2.1 time: 0.469586 Sep 04 16:14:21.921246 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 39/71] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:21 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1312 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:21.927579 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-caf30b34-3281-4ef2-b30f-704d280352f3 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:21.928456 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-caf30b34-3281-4ef2-b30f-704d280352f3 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:21.935193 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-caf30b34-3281-4ef2-b30f-704d280352f3 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:21.935838 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-caf30b34-3281-4ef2-b30f-704d280352f3 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:21.936490 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-caf30b34-3281-4ef2-b30f-704d280352f3 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:21.938033 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-caf30b34-3281-4ef2-b30f-704d280352f3 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:21.938716 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-caf30b34-3281-4ef2-b30f-704d280352f3 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:21.939189 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-caf30b34-3281-4ef2-b30f-704d280352f3 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:21.978029 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-49c0940e-2bb3-40f4-893a-bbca93f934e1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:21.978029 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-49c0940e-2bb3-40f4-893a-bbca93f934e1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1321 microversion: 2.1 time: 1.023946 Sep 04 16:14:21.978029 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 33/72] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:20 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1321 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:22.259282 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d0ff973d-1f11-4954-840c-a1e17a3eec8e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:22.259889 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d0ff973d-1f11-4954-840c-a1e17a3eec8e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:22.268282 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d0ff973d-1f11-4954-840c-a1e17a3eec8e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:22.272008 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d0ff973d-1f11-4954-840c-a1e17a3eec8e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:22.272652 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d0ff973d-1f11-4954-840c-a1e17a3eec8e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:22.273543 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d0ff973d-1f11-4954-840c-a1e17a3eec8e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:22.275659 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d0ff973d-1f11-4954-840c-a1e17a3eec8e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:22.276284 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d0ff973d-1f11-4954-840c-a1e17a3eec8e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:22.382791 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-caf30b34-3281-4ef2-b30f-704d280352f3 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:22.392580 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-caf30b34-3281-4ef2-b30f-704d280352f3 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1315 microversion: 2.1 time: 0.468830 Sep 04 16:14:22.393297 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 40/73] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:21 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:22.810471 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d0ff973d-1f11-4954-840c-a1e17a3eec8e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:22.821669 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d0ff973d-1f11-4954-840c-a1e17a3eec8e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:22.828447 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d0ff973d-1f11-4954-840c-a1e17a3eec8e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:22.834374 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d0ff973d-1f11-4954-840c-a1e17a3eec8e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1407 microversion: 2.20 time: 0.579283 Sep 04 16:14:22.838166 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 34/74] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:22 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1407 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:22.988814 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-16fc3562-8290-45c0-90d6-908594c8afbd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:22.989308 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-16fc3562-8290-45c0-90d6-908594c8afbd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:23.001732 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16fc3562-8290-45c0-90d6-908594c8afbd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:23.003028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16fc3562-8290-45c0-90d6-908594c8afbd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:23.004272 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f2a07af4-7160-4f1a-8ba4-b0808976b250 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:23.004826 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16fc3562-8290-45c0-90d6-908594c8afbd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:23.004933 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f2a07af4-7160-4f1a-8ba4-b0808976b250 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:23.008883 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16fc3562-8290-45c0-90d6-908594c8afbd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:23.012283 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16fc3562-8290-45c0-90d6-908594c8afbd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:23.012990 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-16fc3562-8290-45c0-90d6-908594c8afbd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:23.017809 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f2a07af4-7160-4f1a-8ba4-b0808976b250 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:23.019534 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f2a07af4-7160-4f1a-8ba4-b0808976b250 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:23.022189 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f2a07af4-7160-4f1a-8ba4-b0808976b250 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:23.023365 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f2a07af4-7160-4f1a-8ba4-b0808976b250 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:23.025183 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f2a07af4-7160-4f1a-8ba4-b0808976b250 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:23.026390 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f2a07af4-7160-4f1a-8ba4-b0808976b250 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:23.113765 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:14:23.405007 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f2a07af4-7160-4f1a-8ba4-b0808976b250 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:23.410482 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-16fc3562-8290-45c0-90d6-908594c8afbd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:23.424719 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f2a07af4-7160-4f1a-8ba4-b0808976b250 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1321 microversion: 2.1 time: 0.426272 Sep 04 16:14:23.427153 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-16fc3562-8290-45c0-90d6-908594c8afbd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1367 microversion: 2.1 time: 0.443752 Sep 04 16:14:23.427731 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 41/75] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:22 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1367 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:23.437969 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 35/76] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:22 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1321 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:23.438135 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f333d74d-821c-43ca-aeaa-4b5769a24c76 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:23.438135 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f333d74d-821c-43ca-aeaa-4b5769a24c76 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:23.442025 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f333d74d-821c-43ca-aeaa-4b5769a24c76 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:23.442718 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f333d74d-821c-43ca-aeaa-4b5769a24c76 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:23.443380 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f333d74d-821c-43ca-aeaa-4b5769a24c76 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:23.444279 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f333d74d-821c-43ca-aeaa-4b5769a24c76 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:23.445368 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f333d74d-821c-43ca-aeaa-4b5769a24c76 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:23.446047 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f333d74d-821c-43ca-aeaa-4b5769a24c76 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:23.620675 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f333d74d-821c-43ca-aeaa-4b5769a24c76 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:23.637425 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f333d74d-821c-43ca-aeaa-4b5769a24c76 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1315 microversion: 2.1 time: 0.203490 Sep 04 16:14:23.637425 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 42/77] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:23 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:23.668416 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-65795a95-d2a2-4665-87c7-980447a1a53b req-e23758dd-7cf3-433b-9d0a-a1c775f47b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b95d4253-8af1-41cb-94f9-59b563be0d1d", "name": "network-vif-plugged", "status": "completed", "tag": "432267bf-359a-4cef-aa7e-120c224fc8fe"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:14:23.679671 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-65795a95-d2a2-4665-87c7-980447a1a53b req-e23758dd-7cf3-433b-9d0a-a1c775f47b66 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:23.680150 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-65795a95-d2a2-4665-87c7-980447a1a53b req-e23758dd-7cf3-433b-9d0a-a1c775f47b66 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:23.680575 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-65795a95-d2a2-4665-87c7-980447a1a53b req-e23758dd-7cf3-433b-9d0a-a1c775f47b66 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:23.692495 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-65795a95-d2a2-4665-87c7-980447a1a53b req-e23758dd-7cf3-433b-9d0a-a1c775f47b66 service nova] Creating event network-vif-plugged:432267bf-359a-4cef-aa7e-120c224fc8fe for instance b95d4253-8af1-41cb-94f9-59b563be0d1d on hv-cinder-85236 Sep 04 16:14:23.697160 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-65795a95-d2a2-4665-87c7-980447a1a53b req-e23758dd-7cf3-433b-9d0a-a1c775f47b66 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147086 Sep 04 16:14:23.697940 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 36/78] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:14:23.861699 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b3fa7989-bec0-4716-8b79-8c5d0285db64 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:23.862305 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b3fa7989-bec0-4716-8b79-8c5d0285db64 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:23.868483 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3fa7989-bec0-4716-8b79-8c5d0285db64 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:23.869170 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3fa7989-bec0-4716-8b79-8c5d0285db64 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:23.869608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3fa7989-bec0-4716-8b79-8c5d0285db64 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:23.870312 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3fa7989-bec0-4716-8b79-8c5d0285db64 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:23.870750 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3fa7989-bec0-4716-8b79-8c5d0285db64 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:23.871166 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3fa7989-bec0-4716-8b79-8c5d0285db64 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:24.008740 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b3fa7989-bec0-4716-8b79-8c5d0285db64 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:24.017971 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b3fa7989-bec0-4716-8b79-8c5d0285db64 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:24.019419 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b3fa7989-bec0-4716-8b79-8c5d0285db64 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:24.020501 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b3fa7989-bec0-4716-8b79-8c5d0285db64 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1407 microversion: 2.20 time: 0.163034 Sep 04 16:14:24.021041 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 43/79] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:23 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:24.474404 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9d68a4ba-9f27-46fd-8c99-e773cb2fc9a1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:24.475793 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9d68a4ba-9f27-46fd-8c99-e773cb2fc9a1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:24.479036 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-be2e1a6b-e0cb-4788-9650-9bcf9e37b339 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:24.479702 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-be2e1a6b-e0cb-4788-9650-9bcf9e37b339 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:24.485654 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d68a4ba-9f27-46fd-8c99-e773cb2fc9a1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:24.486415 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d68a4ba-9f27-46fd-8c99-e773cb2fc9a1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:24.487069 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d68a4ba-9f27-46fd-8c99-e773cb2fc9a1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:24.488007 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d68a4ba-9f27-46fd-8c99-e773cb2fc9a1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:24.488681 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d68a4ba-9f27-46fd-8c99-e773cb2fc9a1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:24.488807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be2e1a6b-e0cb-4788-9650-9bcf9e37b339 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:24.489191 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d68a4ba-9f27-46fd-8c99-e773cb2fc9a1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:24.489310 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be2e1a6b-e0cb-4788-9650-9bcf9e37b339 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:24.490331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be2e1a6b-e0cb-4788-9650-9bcf9e37b339 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:24.491948 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be2e1a6b-e0cb-4788-9650-9bcf9e37b339 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:24.492821 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be2e1a6b-e0cb-4788-9650-9bcf9e37b339 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:24.493715 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be2e1a6b-e0cb-4788-9650-9bcf9e37b339 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:24.690480 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9d68a4ba-9f27-46fd-8c99-e773cb2fc9a1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:24.694460 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-be2e1a6b-e0cb-4788-9650-9bcf9e37b339 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:24.703373 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9d68a4ba-9f27-46fd-8c99-e773cb2fc9a1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1321 microversion: 2.1 time: 0.234056 Sep 04 16:14:24.703969 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 37/80] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:24 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:24.706497 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-be2e1a6b-e0cb-4788-9650-9bcf9e37b339 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1367 microversion: 2.1 time: 0.232222 Sep 04 16:14:24.707656 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 44/81] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:24 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:24.711174 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1c6ba740-7ded-499d-880e-230ac57277eb tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:24.712457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1c6ba740-7ded-499d-880e-230ac57277eb tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:24.725355 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1c6ba740-7ded-499d-880e-230ac57277eb tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:24.726273 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1c6ba740-7ded-499d-880e-230ac57277eb tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:24.726703 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1c6ba740-7ded-499d-880e-230ac57277eb tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:24.727565 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1c6ba740-7ded-499d-880e-230ac57277eb tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:24.728050 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1c6ba740-7ded-499d-880e-230ac57277eb tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:24.728642 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1c6ba740-7ded-499d-880e-230ac57277eb tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:24.888902 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1c6ba740-7ded-499d-880e-230ac57277eb tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:24.897045 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1c6ba740-7ded-499d-880e-230ac57277eb tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1315 microversion: 2.1 time: 0.192096 Sep 04 16:14:24.897751 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 38/82] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:24 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:25.045081 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-28988eaf-465f-4157-b8ff-ffe30d73a36d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:25.045814 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-28988eaf-465f-4157-b8ff-ffe30d73a36d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:25.054137 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28988eaf-465f-4157-b8ff-ffe30d73a36d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:25.054977 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28988eaf-465f-4157-b8ff-ffe30d73a36d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:25.055711 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28988eaf-465f-4157-b8ff-ffe30d73a36d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:25.056808 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28988eaf-465f-4157-b8ff-ffe30d73a36d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:25.057268 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28988eaf-465f-4157-b8ff-ffe30d73a36d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:25.058068 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-28988eaf-465f-4157-b8ff-ffe30d73a36d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:25.188548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-28988eaf-465f-4157-b8ff-ffe30d73a36d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:25.197230 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-28988eaf-465f-4157-b8ff-ffe30d73a36d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:25.198699 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-28988eaf-465f-4157-b8ff-ffe30d73a36d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:25.199793 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-28988eaf-465f-4157-b8ff-ffe30d73a36d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1407 microversion: 2.20 time: 0.158401 Sep 04 16:14:25.200349 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 45/83] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:25 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:25.726684 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6b8b4cf0-296c-4508-9d40-3efc8152e3ea tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:25.727240 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6b8b4cf0-296c-4508-9d40-3efc8152e3ea tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:25.730468 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a8e6fa15-e8b0-4feb-9e07-f9f07d6577ed tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:25.731367 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a8e6fa15-e8b0-4feb-9e07-f9f07d6577ed tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:25.733191 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6b8b4cf0-296c-4508-9d40-3efc8152e3ea tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:25.733768 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6b8b4cf0-296c-4508-9d40-3efc8152e3ea tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:25.734738 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6b8b4cf0-296c-4508-9d40-3efc8152e3ea tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:25.735430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6b8b4cf0-296c-4508-9d40-3efc8152e3ea tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:25.735869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6b8b4cf0-296c-4508-9d40-3efc8152e3ea tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:25.736282 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6b8b4cf0-296c-4508-9d40-3efc8152e3ea tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:25.738285 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8e6fa15-e8b0-4feb-9e07-f9f07d6577ed tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:25.738765 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8e6fa15-e8b0-4feb-9e07-f9f07d6577ed tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:25.739196 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8e6fa15-e8b0-4feb-9e07-f9f07d6577ed tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:25.744013 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8e6fa15-e8b0-4feb-9e07-f9f07d6577ed tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:25.744013 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8e6fa15-e8b0-4feb-9e07-f9f07d6577ed tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:25.744013 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8e6fa15-e8b0-4feb-9e07-f9f07d6577ed tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:25.930646 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6b8b4cf0-296c-4508-9d40-3efc8152e3ea tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:25.950348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a8e6fa15-e8b0-4feb-9e07-f9f07d6577ed tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:25.950857 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6b8b4cf0-296c-4508-9d40-3efc8152e3ea tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1321 microversion: 2.1 time: 0.221061 Sep 04 16:14:25.950857 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 39/84] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:25 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:25.950857 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-df3514a8-1c91-4853-86e1-bce48c44c2c8 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:25.950857 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-df3514a8-1c91-4853-86e1-bce48c44c2c8 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:25.951198 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a8e6fa15-e8b0-4feb-9e07-f9f07d6577ed tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1367 microversion: 2.1 time: 0.222986 Sep 04 16:14:25.951198 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 46/85] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:25 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:25.956161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-df3514a8-1c91-4853-86e1-bce48c44c2c8 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:25.956766 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-df3514a8-1c91-4853-86e1-bce48c44c2c8 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:25.957277 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-df3514a8-1c91-4853-86e1-bce48c44c2c8 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:25.958077 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-df3514a8-1c91-4853-86e1-bce48c44c2c8 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:25.958593 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-df3514a8-1c91-4853-86e1-bce48c44c2c8 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:25.959090 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-df3514a8-1c91-4853-86e1-bce48c44c2c8 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:26.090957 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-df3514a8-1c91-4853-86e1-bce48c44c2c8 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:26.100492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-df3514a8-1c91-4853-86e1-bce48c44c2c8 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1315 microversion: 2.1 time: 0.155112 Sep 04 16:14:26.101147 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 40/86] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:25 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:26.226910 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0901a0f7-f747-4d45-a600-0811947b6183 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:26.227516 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0901a0f7-f747-4d45-a600-0811947b6183 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:26.233660 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0901a0f7-f747-4d45-a600-0811947b6183 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:26.234883 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0901a0f7-f747-4d45-a600-0811947b6183 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:26.235317 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0901a0f7-f747-4d45-a600-0811947b6183 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:26.236006 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0901a0f7-f747-4d45-a600-0811947b6183 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:26.236469 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0901a0f7-f747-4d45-a600-0811947b6183 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:26.236884 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0901a0f7-f747-4d45-a600-0811947b6183 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:26.256068 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:14:26.374659 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0901a0f7-f747-4d45-a600-0811947b6183 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:26.384626 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0901a0f7-f747-4d45-a600-0811947b6183 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:26.386103 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0901a0f7-f747-4d45-a600-0811947b6183 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:26.387639 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0901a0f7-f747-4d45-a600-0811947b6183 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1407 microversion: 2.20 time: 0.164706 Sep 04 16:14:26.388780 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 47/87] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:26 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:26.967988 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8bbbadc9-491e-4b8d-aa6a-b05309744ad2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:26.969084 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8bbbadc9-491e-4b8d-aa6a-b05309744ad2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:26.976057 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8bbbadc9-491e-4b8d-aa6a-b05309744ad2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:26.976539 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8bbbadc9-491e-4b8d-aa6a-b05309744ad2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:26.976904 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-660cfe9a-7b22-4442-9570-9c96e24eaf54 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:26.977042 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8bbbadc9-491e-4b8d-aa6a-b05309744ad2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:26.977660 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8bbbadc9-491e-4b8d-aa6a-b05309744ad2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:26.977858 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-660cfe9a-7b22-4442-9570-9c96e24eaf54 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:26.978107 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8bbbadc9-491e-4b8d-aa6a-b05309744ad2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:26.978523 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8bbbadc9-491e-4b8d-aa6a-b05309744ad2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:26.985327 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-660cfe9a-7b22-4442-9570-9c96e24eaf54 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:26.986485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-660cfe9a-7b22-4442-9570-9c96e24eaf54 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:26.986943 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-660cfe9a-7b22-4442-9570-9c96e24eaf54 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:26.987643 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-660cfe9a-7b22-4442-9570-9c96e24eaf54 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:26.988093 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-660cfe9a-7b22-4442-9570-9c96e24eaf54 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:26.988516 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-660cfe9a-7b22-4442-9570-9c96e24eaf54 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:27.189816 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8bbbadc9-491e-4b8d-aa6a-b05309744ad2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:27.194972 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-660cfe9a-7b22-4442-9570-9c96e24eaf54 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:27.197777 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8bbbadc9-491e-4b8d-aa6a-b05309744ad2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1321 microversion: 2.1 time: 0.233811 Sep 04 16:14:27.198362 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 41/88] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:26 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:27.203595 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ec623a77-bd47-4cf5-a055-d3c5a948103c tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:27.204427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ec623a77-bd47-4cf5-a055-d3c5a948103c tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:27.207041 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-660cfe9a-7b22-4442-9570-9c96e24eaf54 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1367 microversion: 2.1 time: 0.234946 Sep 04 16:14:27.207694 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 48/89] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:26 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:27.217702 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec623a77-bd47-4cf5-a055-d3c5a948103c tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:27.218289 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec623a77-bd47-4cf5-a055-d3c5a948103c tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:27.219390 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec623a77-bd47-4cf5-a055-d3c5a948103c tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:27.220098 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec623a77-bd47-4cf5-a055-d3c5a948103c tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:27.220551 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec623a77-bd47-4cf5-a055-d3c5a948103c tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:27.220977 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec623a77-bd47-4cf5-a055-d3c5a948103c tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:27.354521 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ec623a77-bd47-4cf5-a055-d3c5a948103c tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:27.363930 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ec623a77-bd47-4cf5-a055-d3c5a948103c tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1315 microversion: 2.1 time: 0.164526 Sep 04 16:14:27.364518 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 42/90] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:27 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:27.414095 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9079b048-8e40-416f-aec1-3f8960636236 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:27.414803 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9079b048-8e40-416f-aec1-3f8960636236 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:27.420727 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9079b048-8e40-416f-aec1-3f8960636236 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:27.421209 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9079b048-8e40-416f-aec1-3f8960636236 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:27.422612 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9079b048-8e40-416f-aec1-3f8960636236 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:27.423114 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9079b048-8e40-416f-aec1-3f8960636236 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:27.423563 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9079b048-8e40-416f-aec1-3f8960636236 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:27.423987 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9079b048-8e40-416f-aec1-3f8960636236 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:27.561710 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-9079b048-8e40-416f-aec1-3f8960636236 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:27.570025 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-9079b048-8e40-416f-aec1-3f8960636236 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:27.571642 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-9079b048-8e40-416f-aec1-3f8960636236 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:27.572734 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9079b048-8e40-416f-aec1-3f8960636236 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1407 microversion: 2.20 time: 0.162633 Sep 04 16:14:27.573284 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 49/91] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:27 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:28.222048 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-56bf70bd-b8c9-4c35-b16c-a70b85658168 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:28.222678 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-56bf70bd-b8c9-4c35-b16c-a70b85658168 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:28.228650 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-56bf70bd-b8c9-4c35-b16c-a70b85658168 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:28.229135 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-56bf70bd-b8c9-4c35-b16c-a70b85658168 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:28.229649 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-56bf70bd-b8c9-4c35-b16c-a70b85658168 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:28.230279 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-56bf70bd-b8c9-4c35-b16c-a70b85658168 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:28.230437 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4dfb265f-9855-4a4d-a7cc-f81e47f9a890 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:28.230729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-56bf70bd-b8c9-4c35-b16c-a70b85658168 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:28.231038 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4dfb265f-9855-4a4d-a7cc-f81e47f9a890 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:28.231140 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-56bf70bd-b8c9-4c35-b16c-a70b85658168 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:28.237958 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dfb265f-9855-4a4d-a7cc-f81e47f9a890 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:28.238430 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dfb265f-9855-4a4d-a7cc-f81e47f9a890 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:28.238858 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dfb265f-9855-4a4d-a7cc-f81e47f9a890 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:28.239536 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dfb265f-9855-4a4d-a7cc-f81e47f9a890 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:28.239978 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dfb265f-9855-4a4d-a7cc-f81e47f9a890 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:28.240393 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4dfb265f-9855-4a4d-a7cc-f81e47f9a890 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:28.427096 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-56bf70bd-b8c9-4c35-b16c-a70b85658168 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:28.430621 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:14:28.431174 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4dfb265f-9855-4a4d-a7cc-f81e47f9a890 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:28.435319 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-56bf70bd-b8c9-4c35-b16c-a70b85658168 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1321 microversion: 2.1 time: 0.218099 Sep 04 16:14:28.436104 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 43/92] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:28 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:28.439097 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4dfb265f-9855-4a4d-a7cc-f81e47f9a890 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1367 microversion: 2.1 time: 0.212380 Sep 04 16:14:28.439662 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 50/93] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:28 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:28.440558 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8d79c919-53de-44c4-95a4-8680293ead92 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:28.441159 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8d79c919-53de-44c4-95a4-8680293ead92 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:28.447001 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8d79c919-53de-44c4-95a4-8680293ead92 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:28.447476 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8d79c919-53de-44c4-95a4-8680293ead92 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:28.449667 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8d79c919-53de-44c4-95a4-8680293ead92 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:28.449667 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8d79c919-53de-44c4-95a4-8680293ead92 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:28.449667 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8d79c919-53de-44c4-95a4-8680293ead92 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:28.449667 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8d79c919-53de-44c4-95a4-8680293ead92 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:28.581848 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8d79c919-53de-44c4-95a4-8680293ead92 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:28.589580 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8d79c919-53de-44c4-95a4-8680293ead92 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1315 microversion: 2.1 time: 0.152719 Sep 04 16:14:28.590154 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 44/94] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:28 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:28.598990 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-812f47ea-8c13-443e-93c8-c00f434614f4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:28.598990 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-812f47ea-8c13-443e-93c8-c00f434614f4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:28.611966 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-812f47ea-8c13-443e-93c8-c00f434614f4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:28.612457 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-812f47ea-8c13-443e-93c8-c00f434614f4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:28.612893 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-812f47ea-8c13-443e-93c8-c00f434614f4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:28.613612 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-812f47ea-8c13-443e-93c8-c00f434614f4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:28.614069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-812f47ea-8c13-443e-93c8-c00f434614f4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:28.614581 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-812f47ea-8c13-443e-93c8-c00f434614f4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:28.740962 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-812f47ea-8c13-443e-93c8-c00f434614f4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:28.754102 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-812f47ea-8c13-443e-93c8-c00f434614f4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:28.755445 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-812f47ea-8c13-443e-93c8-c00f434614f4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:28.756537 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-812f47ea-8c13-443e-93c8-c00f434614f4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1407 microversion: 2.20 time: 0.163263 Sep 04 16:14:28.757091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 51/95] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:28 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:29.465920 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-db12fc62-8647-4a5c-b4e6-4b13fc1326f5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:29.467486 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-10876e58-dc41-4332-b7e3-f42858241d87 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:29.468739 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-db12fc62-8647-4a5c-b4e6-4b13fc1326f5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:29.469292 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-10876e58-dc41-4332-b7e3-f42858241d87 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:29.478279 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db12fc62-8647-4a5c-b4e6-4b13fc1326f5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:29.479040 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db12fc62-8647-4a5c-b4e6-4b13fc1326f5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:29.479644 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10876e58-dc41-4332-b7e3-f42858241d87 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:29.480069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db12fc62-8647-4a5c-b4e6-4b13fc1326f5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:29.480348 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10876e58-dc41-4332-b7e3-f42858241d87 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:29.480943 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10876e58-dc41-4332-b7e3-f42858241d87 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:29.482279 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db12fc62-8647-4a5c-b4e6-4b13fc1326f5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:29.482395 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10876e58-dc41-4332-b7e3-f42858241d87 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:29.483057 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10876e58-dc41-4332-b7e3-f42858241d87 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:29.483272 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db12fc62-8647-4a5c-b4e6-4b13fc1326f5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:29.483483 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10876e58-dc41-4332-b7e3-f42858241d87 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:29.485489 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db12fc62-8647-4a5c-b4e6-4b13fc1326f5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:29.732764 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-10876e58-dc41-4332-b7e3-f42858241d87 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:29.735897 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-db12fc62-8647-4a5c-b4e6-4b13fc1326f5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:29.744454 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-db12fc62-8647-4a5c-b4e6-4b13fc1326f5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1367 microversion: 2.1 time: 0.285013 Sep 04 16:14:29.745024 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 52/96] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:29 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:29.749954 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-10876e58-dc41-4332-b7e3-f42858241d87 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1321 microversion: 2.1 time: 0.293259 Sep 04 16:14:29.750507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-286c8d90-595b-4fc8-b03b-cb002aa4505e tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:29.751273 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-286c8d90-595b-4fc8-b03b-cb002aa4505e tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:29.758094 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-286c8d90-595b-4fc8-b03b-cb002aa4505e tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:29.758711 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-286c8d90-595b-4fc8-b03b-cb002aa4505e tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:29.759283 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-286c8d90-595b-4fc8-b03b-cb002aa4505e tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:29.760136 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-286c8d90-595b-4fc8-b03b-cb002aa4505e tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:29.760587 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-286c8d90-595b-4fc8-b03b-cb002aa4505e tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:29.761009 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-286c8d90-595b-4fc8-b03b-cb002aa4505e tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:29.763734 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 45/97] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:29 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:29.787844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e6af8eb3-7a1f-48fa-850a-d6cde46a255c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:29.790885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e6af8eb3-7a1f-48fa-850a-d6cde46a255c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:29.800387 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e6af8eb3-7a1f-48fa-850a-d6cde46a255c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:29.801105 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e6af8eb3-7a1f-48fa-850a-d6cde46a255c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:29.801720 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e6af8eb3-7a1f-48fa-850a-d6cde46a255c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:29.803089 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e6af8eb3-7a1f-48fa-850a-d6cde46a255c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:29.804110 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e6af8eb3-7a1f-48fa-850a-d6cde46a255c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:29.804728 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e6af8eb3-7a1f-48fa-850a-d6cde46a255c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:30.182231 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-286c8d90-595b-4fc8-b03b-cb002aa4505e tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:30.182638 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-286c8d90-595b-4fc8-b03b-cb002aa4505e tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1315 microversion: 2.1 time: 0.434934 Sep 04 16:14:30.185926 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 53/98] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:29 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:30.191910 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-d545c9a8-175f-44db-88a2-3bce8286c841 req-a0cd8f29-0038-4b77-9dd1-c609058126be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "449c2258-280e-405f-a3d1-498688a52529", "tag": "34cf8243-0fd0-4c2f-b7aa-78222c3a9a6a"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:14:30.206216 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d545c9a8-175f-44db-88a2-3bce8286c841 req-a0cd8f29-0038-4b77-9dd1-c609058126be service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:30.206631 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d545c9a8-175f-44db-88a2-3bce8286c841 req-a0cd8f29-0038-4b77-9dd1-c609058126be service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:30.207031 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-d545c9a8-175f-44db-88a2-3bce8286c841 req-a0cd8f29-0038-4b77-9dd1-c609058126be service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:30.213830 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e6af8eb3-7a1f-48fa-850a-d6cde46a255c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:30.221189 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-d545c9a8-175f-44db-88a2-3bce8286c841 req-a0cd8f29-0038-4b77-9dd1-c609058126be service nova] Creating event network-changed:34cf8243-0fd0-4c2f-b7aa-78222c3a9a6a for instance 449c2258-280e-405f-a3d1-498688a52529 on hv-cinder-85236 Sep 04 16:14:30.225250 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e6af8eb3-7a1f-48fa-850a-d6cde46a255c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:30.227001 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e6af8eb3-7a1f-48fa-850a-d6cde46a255c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:30.228243 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-d545c9a8-175f-44db-88a2-3bce8286c841 req-a0cd8f29-0038-4b77-9dd1-c609058126be service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040287 Sep 04 16:14:30.228404 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e6af8eb3-7a1f-48fa-850a-d6cde46a255c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1407 microversion: 2.20 time: 0.450580 Sep 04 16:14:30.229158 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 46/99] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:29 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1407 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:30.234086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 54/100] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:14:30.767893 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f07918ed-2a7b-40a0-bfad-1e869d70eda4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:30.768526 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f07918ed-2a7b-40a0-bfad-1e869d70eda4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:30.775125 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f07918ed-2a7b-40a0-bfad-1e869d70eda4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:30.775620 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f865786e-5366-4d8f-9c6f-3ec2dc3c3c9d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:30.776224 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f07918ed-2a7b-40a0-bfad-1e869d70eda4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:30.776383 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f865786e-5366-4d8f-9c6f-3ec2dc3c3c9d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:30.780711 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f07918ed-2a7b-40a0-bfad-1e869d70eda4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:30.780711 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f07918ed-2a7b-40a0-bfad-1e869d70eda4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:30.783634 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f07918ed-2a7b-40a0-bfad-1e869d70eda4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:30.784218 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f865786e-5366-4d8f-9c6f-3ec2dc3c3c9d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:30.784357 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f07918ed-2a7b-40a0-bfad-1e869d70eda4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:30.785106 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f865786e-5366-4d8f-9c6f-3ec2dc3c3c9d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:30.785744 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f865786e-5366-4d8f-9c6f-3ec2dc3c3c9d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:30.786607 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f865786e-5366-4d8f-9c6f-3ec2dc3c3c9d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:30.787208 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f865786e-5366-4d8f-9c6f-3ec2dc3c3c9d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:30.787636 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f865786e-5366-4d8f-9c6f-3ec2dc3c3c9d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:31.137660 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f865786e-5366-4d8f-9c6f-3ec2dc3c3c9d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:31.140856 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f07918ed-2a7b-40a0-bfad-1e869d70eda4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:31.141090 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f865786e-5366-4d8f-9c6f-3ec2dc3c3c9d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1321 microversion: 2.1 time: 0.368945 Sep 04 16:14:31.142637 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 55/101] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:30 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1321 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:31.150062 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f07918ed-2a7b-40a0-bfad-1e869d70eda4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1367 microversion: 2.1 time: 0.386389 Sep 04 16:14:31.154589 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 47/102] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:30 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1367 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:31.205893 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bd33dcf0-6ee7-402a-b02b-9c0928261760 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:31.206604 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bd33dcf0-6ee7-402a-b02b-9c0928261760 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:31.216398 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd33dcf0-6ee7-402a-b02b-9c0928261760 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:31.220147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd33dcf0-6ee7-402a-b02b-9c0928261760 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:31.220686 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd33dcf0-6ee7-402a-b02b-9c0928261760 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:31.221518 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd33dcf0-6ee7-402a-b02b-9c0928261760 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:31.222281 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd33dcf0-6ee7-402a-b02b-9c0928261760 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:31.222804 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bd33dcf0-6ee7-402a-b02b-9c0928261760 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:31.254701 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5b45eed0-48e5-4858-86ab-9a08606f05d6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:31.256024 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5b45eed0-48e5-4858-86ab-9a08606f05d6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:31.267587 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5b45eed0-48e5-4858-86ab-9a08606f05d6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:31.269595 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5b45eed0-48e5-4858-86ab-9a08606f05d6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:31.270403 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5b45eed0-48e5-4858-86ab-9a08606f05d6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:31.273061 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5b45eed0-48e5-4858-86ab-9a08606f05d6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:31.276506 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5b45eed0-48e5-4858-86ab-9a08606f05d6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:31.277207 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5b45eed0-48e5-4858-86ab-9a08606f05d6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:31.595700 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-bd33dcf0-6ee7-402a-b02b-9c0928261760 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:31.604700 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bd33dcf0-6ee7-402a-b02b-9c0928261760 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1315 microversion: 2.1 time: 0.402026 Sep 04 16:14:31.606237 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 56/103] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:31 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:31.613172 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5b45eed0-48e5-4858-86ab-9a08606f05d6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:31.623329 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-bfb87967-6524-42d4-a395-ca145bf1f696 req-d1fdd457-b458-4f77-b35e-191a5a542e03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee1afbcb-161b-4255-af5d-7aa20d2bf66f", "name": "network-vif-plugged", "status": "completed", "tag": "9b25d6f3-c217-4ae7-8acc-96e8367604e3"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:14:31.629972 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5b45eed0-48e5-4858-86ab-9a08606f05d6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:31.631452 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5b45eed0-48e5-4858-86ab-9a08606f05d6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:31.632734 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5b45eed0-48e5-4858-86ab-9a08606f05d6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1407 microversion: 2.20 time: 0.383255 Sep 04 16:14:31.633780 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 48/104] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:31 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1407 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:31.646829 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-bfb87967-6524-42d4-a395-ca145bf1f696 req-d1fdd457-b458-4f77-b35e-191a5a542e03 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:31.647520 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-bfb87967-6524-42d4-a395-ca145bf1f696 req-d1fdd457-b458-4f77-b35e-191a5a542e03 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:31.648750 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-bfb87967-6524-42d4-a395-ca145bf1f696 req-d1fdd457-b458-4f77-b35e-191a5a542e03 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:31.665558 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-bfb87967-6524-42d4-a395-ca145bf1f696 req-d1fdd457-b458-4f77-b35e-191a5a542e03 service nova] Creating event network-vif-plugged:9b25d6f3-c217-4ae7-8acc-96e8367604e3 for instance ee1afbcb-161b-4255-af5d-7aa20d2bf66f on hv-cinder-85236 Sep 04 16:14:31.672373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-bfb87967-6524-42d4-a395-ca145bf1f696 req-d1fdd457-b458-4f77-b35e-191a5a542e03 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062830 Sep 04 16:14:31.673104 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 57/105] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:14:32.166959 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cd4b5322-869a-4ad4-b86d-dba8d43b0866 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:32.167675 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cd4b5322-869a-4ad4-b86d-dba8d43b0866 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:32.174380 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd4b5322-869a-4ad4-b86d-dba8d43b0866 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:32.174891 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd4b5322-869a-4ad4-b86d-dba8d43b0866 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:32.175602 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd4b5322-869a-4ad4-b86d-dba8d43b0866 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:32.176467 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd4b5322-869a-4ad4-b86d-dba8d43b0866 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:32.177072 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd4b5322-869a-4ad4-b86d-dba8d43b0866 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:32.177668 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd4b5322-869a-4ad4-b86d-dba8d43b0866 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:32.181332 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5c1131aa-d6b3-4755-b37e-55227b7e303c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:32.182592 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5c1131aa-d6b3-4755-b37e-55227b7e303c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:32.194749 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c1131aa-d6b3-4755-b37e-55227b7e303c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:32.195237 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c1131aa-d6b3-4755-b37e-55227b7e303c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:32.197955 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c1131aa-d6b3-4755-b37e-55227b7e303c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:32.199062 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c1131aa-d6b3-4755-b37e-55227b7e303c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:32.199535 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c1131aa-d6b3-4755-b37e-55227b7e303c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:32.199960 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c1131aa-d6b3-4755-b37e-55227b7e303c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:32.388977 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-cd4b5322-869a-4ad4-b86d-dba8d43b0866 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:32.396865 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5c1131aa-d6b3-4755-b37e-55227b7e303c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:32.398038 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cd4b5322-869a-4ad4-b86d-dba8d43b0866 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1321 microversion: 2.1 time: 0.234969 Sep 04 16:14:32.399224 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 49/106] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:32 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:32.405001 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5c1131aa-d6b3-4755-b37e-55227b7e303c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1367 microversion: 2.1 time: 0.228141 Sep 04 16:14:32.405558 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 58/107] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:32 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:32.632804 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-438fb4b3-d258-4742-8552-5cef548d5e81 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:32.633538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-438fb4b3-d258-4742-8552-5cef548d5e81 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:32.640350 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-438fb4b3-d258-4742-8552-5cef548d5e81 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:32.641194 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-438fb4b3-d258-4742-8552-5cef548d5e81 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:32.641893 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-438fb4b3-d258-4742-8552-5cef548d5e81 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:32.643183 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-438fb4b3-d258-4742-8552-5cef548d5e81 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:32.643638 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-438fb4b3-d258-4742-8552-5cef548d5e81 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:32.644129 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-438fb4b3-d258-4742-8552-5cef548d5e81 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:32.664147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-34da40b8-07c5-4414-8071-6c42a2f99637 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:32.665157 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-34da40b8-07c5-4414-8071-6c42a2f99637 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:32.671206 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-34da40b8-07c5-4414-8071-6c42a2f99637 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:32.672474 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-34da40b8-07c5-4414-8071-6c42a2f99637 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:32.673046 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-34da40b8-07c5-4414-8071-6c42a2f99637 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:32.673962 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-34da40b8-07c5-4414-8071-6c42a2f99637 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:32.674553 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-34da40b8-07c5-4414-8071-6c42a2f99637 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:32.675175 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-34da40b8-07c5-4414-8071-6c42a2f99637 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:32.892852 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-438fb4b3-d258-4742-8552-5cef548d5e81 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:32.900123 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-34da40b8-07c5-4414-8071-6c42a2f99637 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:32.906549 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-438fb4b3-d258-4742-8552-5cef548d5e81 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1315 microversion: 2.1 time: 0.274150 Sep 04 16:14:32.906549 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 50/108] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:32 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:32.921468 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-34da40b8-07c5-4414-8071-6c42a2f99637 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:32.923769 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-34da40b8-07c5-4414-8071-6c42a2f99637 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:32.924905 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-34da40b8-07c5-4414-8071-6c42a2f99637 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1407 microversion: 2.20 time: 0.264565 Sep 04 16:14:32.925465 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 59/109] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:32 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:14:33.425146 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a38b76a9-028f-43e7-968e-48fd6dc96f0d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:33.425146 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a38b76a9-028f-43e7-968e-48fd6dc96f0d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:33.433950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a4399bb5-dd3f-435d-805f-76518ff8b04b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:33.434438 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a38b76a9-028f-43e7-968e-48fd6dc96f0d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:33.434618 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a4399bb5-dd3f-435d-805f-76518ff8b04b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:33.441458 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a38b76a9-028f-43e7-968e-48fd6dc96f0d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:33.442110 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a38b76a9-028f-43e7-968e-48fd6dc96f0d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:33.443301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a38b76a9-028f-43e7-968e-48fd6dc96f0d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:33.443861 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a38b76a9-028f-43e7-968e-48fd6dc96f0d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:33.444338 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a38b76a9-028f-43e7-968e-48fd6dc96f0d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:33.446916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a4399bb5-dd3f-435d-805f-76518ff8b04b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:33.447542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a4399bb5-dd3f-435d-805f-76518ff8b04b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:33.447806 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a4399bb5-dd3f-435d-805f-76518ff8b04b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:33.448567 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a4399bb5-dd3f-435d-805f-76518ff8b04b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:33.448961 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a4399bb5-dd3f-435d-805f-76518ff8b04b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:33.449328 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a4399bb5-dd3f-435d-805f-76518ff8b04b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:33.715668 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a38b76a9-028f-43e7-968e-48fd6dc96f0d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:33.719997 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a4399bb5-dd3f-435d-805f-76518ff8b04b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:33.724057 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a38b76a9-028f-43e7-968e-48fd6dc96f0d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1321 microversion: 2.1 time: 0.306854 Sep 04 16:14:33.724883 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 51/110] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:33 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1321 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:33.727878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a4399bb5-dd3f-435d-805f-76518ff8b04b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1367 microversion: 2.1 time: 0.304151 Sep 04 16:14:33.728435 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 60/111] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:33 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1367 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:33.924707 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a1764f59-bd6f-48af-9ab5-a20eda2d5fac tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:33.925311 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a1764f59-bd6f-48af-9ab5-a20eda2d5fac tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:33.932011 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1764f59-bd6f-48af-9ab5-a20eda2d5fac tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:33.932523 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1764f59-bd6f-48af-9ab5-a20eda2d5fac tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:33.933042 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1764f59-bd6f-48af-9ab5-a20eda2d5fac tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:33.933760 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1764f59-bd6f-48af-9ab5-a20eda2d5fac tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:33.934204 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1764f59-bd6f-48af-9ab5-a20eda2d5fac tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:33.934620 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1764f59-bd6f-48af-9ab5-a20eda2d5fac tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:33.953430 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ac766dfa-bd3d-4216-9760-01f181ced60c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:33.954119 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ac766dfa-bd3d-4216-9760-01f181ced60c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:33.961552 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac766dfa-bd3d-4216-9760-01f181ced60c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:33.962094 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac766dfa-bd3d-4216-9760-01f181ced60c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:33.962757 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac766dfa-bd3d-4216-9760-01f181ced60c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:33.963403 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac766dfa-bd3d-4216-9760-01f181ced60c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:33.963856 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac766dfa-bd3d-4216-9760-01f181ced60c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:33.964279 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ac766dfa-bd3d-4216-9760-01f181ced60c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:34.154597 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a1764f59-bd6f-48af-9ab5-a20eda2d5fac tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:34.158160 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ac766dfa-bd3d-4216-9760-01f181ced60c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:34.166565 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ac766dfa-bd3d-4216-9760-01f181ced60c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:34.170511 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ac766dfa-bd3d-4216-9760-01f181ced60c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:34.170971 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a1764f59-bd6f-48af-9ab5-a20eda2d5fac tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1315 microversion: 2.1 time: 0.248399 Sep 04 16:14:34.173134 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ac766dfa-bd3d-4216-9760-01f181ced60c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1407 microversion: 2.20 time: 0.226298 Sep 04 16:14:34.173748 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 61/112] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:33 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:14:34.174474 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 52/113] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:33 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:34.748851 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-41c3d353-c2dd-45cf-9d94-c397f308e6ee tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:34.755086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d2a77e5a-38a0-477c-a916-f155d1712212 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:34.755805 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d2a77e5a-38a0-477c-a916-f155d1712212 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:34.759949 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-41c3d353-c2dd-45cf-9d94-c397f308e6ee tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:34.769827 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2a77e5a-38a0-477c-a916-f155d1712212 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:34.770837 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-41c3d353-c2dd-45cf-9d94-c397f308e6ee tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:34.771324 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-41c3d353-c2dd-45cf-9d94-c397f308e6ee tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:34.771773 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-41c3d353-c2dd-45cf-9d94-c397f308e6ee tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:34.772554 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-41c3d353-c2dd-45cf-9d94-c397f308e6ee tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:34.772922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-41c3d353-c2dd-45cf-9d94-c397f308e6ee tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:34.773516 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-41c3d353-c2dd-45cf-9d94-c397f308e6ee tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:34.773770 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2a77e5a-38a0-477c-a916-f155d1712212 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:34.774227 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2a77e5a-38a0-477c-a916-f155d1712212 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:34.774941 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2a77e5a-38a0-477c-a916-f155d1712212 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:34.775399 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2a77e5a-38a0-477c-a916-f155d1712212 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:34.775830 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2a77e5a-38a0-477c-a916-f155d1712212 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:34.972011 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-41c3d353-c2dd-45cf-9d94-c397f308e6ee tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:34.983128 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-41c3d353-c2dd-45cf-9d94-c397f308e6ee tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1321 microversion: 2.1 time: 0.238458 Sep 04 16:14:34.985606 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 53/114] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:34 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:35.004574 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d2a77e5a-38a0-477c-a916-f155d1712212 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:35.012737 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d2a77e5a-38a0-477c-a916-f155d1712212 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1367 microversion: 2.1 time: 0.261517 Sep 04 16:14:35.032116 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 62/115] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:34 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1367 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:35.196677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fd37545d-ad5e-4ca7-87b0-777581669492 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:35.197642 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fd37545d-ad5e-4ca7-87b0-777581669492 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:35.199540 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0c8d951a-8b29-4fd3-a118-2e021e6b0682 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:35.200154 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0c8d951a-8b29-4fd3-a118-2e021e6b0682 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:35.206731 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c8d951a-8b29-4fd3-a118-2e021e6b0682 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:35.207211 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c8d951a-8b29-4fd3-a118-2e021e6b0682 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:35.207754 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c8d951a-8b29-4fd3-a118-2e021e6b0682 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:35.208106 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fd37545d-ad5e-4ca7-87b0-777581669492 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:35.208504 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c8d951a-8b29-4fd3-a118-2e021e6b0682 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:35.208952 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c8d951a-8b29-4fd3-a118-2e021e6b0682 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:35.209166 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fd37545d-ad5e-4ca7-87b0-777581669492 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:35.209380 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c8d951a-8b29-4fd3-a118-2e021e6b0682 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:35.209640 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fd37545d-ad5e-4ca7-87b0-777581669492 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:35.210337 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fd37545d-ad5e-4ca7-87b0-777581669492 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:35.210790 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fd37545d-ad5e-4ca7-87b0-777581669492 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:35.211323 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fd37545d-ad5e-4ca7-87b0-777581669492 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:35.440591 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fd37545d-ad5e-4ca7-87b0-777581669492 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:35.448304 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fd37545d-ad5e-4ca7-87b0-777581669492 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1315 microversion: 2.1 time: 0.255410 Sep 04 16:14:35.462032 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 54/116] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:35 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:35.471778 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0c8d951a-8b29-4fd3-a118-2e021e6b0682 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:35.486878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0c8d951a-8b29-4fd3-a118-2e021e6b0682 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:35.488796 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0c8d951a-8b29-4fd3-a118-2e021e6b0682 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:35.491580 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0c8d951a-8b29-4fd3-a118-2e021e6b0682 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1407 microversion: 2.20 time: 0.296268 Sep 04 16:14:35.492436 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 63/117] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:35 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1407 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:14:35.644282 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-ae44bc54-6361-4bd1-8cf3-a1c14a8ad80d req-1a6b972b-aad0-4a5a-bcac-4b6d793e49b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df07895-c9cb-4cee-93e7-1cafff31b091", "name": "network-vif-plugged", "status": "completed", "tag": "dab8e735-7496-45d4-bc92-b047426a274b"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:14:35.654000 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-ae44bc54-6361-4bd1-8cf3-a1c14a8ad80d req-1a6b972b-aad0-4a5a-bcac-4b6d793e49b5 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:35.654480 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-ae44bc54-6361-4bd1-8cf3-a1c14a8ad80d req-1a6b972b-aad0-4a5a-bcac-4b6d793e49b5 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:35.654907 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-ae44bc54-6361-4bd1-8cf3-a1c14a8ad80d req-1a6b972b-aad0-4a5a-bcac-4b6d793e49b5 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:35.666920 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-ae44bc54-6361-4bd1-8cf3-a1c14a8ad80d req-1a6b972b-aad0-4a5a-bcac-4b6d793e49b5 service nova] Creating event network-vif-plugged:dab8e735-7496-45d4-bc92-b047426a274b for instance 9df07895-c9cb-4cee-93e7-1cafff31b091 on hv-cinder-85236 Sep 04 16:14:35.672338 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-ae44bc54-6361-4bd1-8cf3-a1c14a8ad80d req-1a6b972b-aad0-4a5a-bcac-4b6d793e49b5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031290 Sep 04 16:14:35.672993 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 55/118] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:14:36.012421 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1a05fe8c-6307-4a00-9c4a-0c27e71dec1e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:36.013636 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1a05fe8c-6307-4a00-9c4a-0c27e71dec1e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:36.021389 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a05fe8c-6307-4a00-9c4a-0c27e71dec1e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:36.023890 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a05fe8c-6307-4a00-9c4a-0c27e71dec1e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:36.029755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a05fe8c-6307-4a00-9c4a-0c27e71dec1e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:36.029755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a05fe8c-6307-4a00-9c4a-0c27e71dec1e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:36.029755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a05fe8c-6307-4a00-9c4a-0c27e71dec1e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:36.029755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1a05fe8c-6307-4a00-9c4a-0c27e71dec1e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:36.039601 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c3b6fbc3-1876-4dbb-9caf-33f332f6954e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:36.041530 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c3b6fbc3-1876-4dbb-9caf-33f332f6954e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:36.050217 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c3b6fbc3-1876-4dbb-9caf-33f332f6954e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:36.058499 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c3b6fbc3-1876-4dbb-9caf-33f332f6954e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:36.058499 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c3b6fbc3-1876-4dbb-9caf-33f332f6954e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:36.058499 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c3b6fbc3-1876-4dbb-9caf-33f332f6954e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:36.058499 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c3b6fbc3-1876-4dbb-9caf-33f332f6954e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:36.058888 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c3b6fbc3-1876-4dbb-9caf-33f332f6954e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:36.302581 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c3b6fbc3-1876-4dbb-9caf-33f332f6954e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:36.304700 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1a05fe8c-6307-4a00-9c4a-0c27e71dec1e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:36.314966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c3b6fbc3-1876-4dbb-9caf-33f332f6954e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1367 microversion: 2.1 time: 0.279441 Sep 04 16:14:36.315758 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1a05fe8c-6307-4a00-9c4a-0c27e71dec1e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1321 microversion: 2.1 time: 0.310878 Sep 04 16:14:36.316412 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 64/119] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:36 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:36.325255 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 56/120] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:36 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:36.474006 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8b445465-5556-44a4-903c-2eda6d7759c4 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:36.476692 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8b445465-5556-44a4-903c-2eda6d7759c4 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:36.492592 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b445465-5556-44a4-903c-2eda6d7759c4 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:36.493733 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b445465-5556-44a4-903c-2eda6d7759c4 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:36.494509 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b445465-5556-44a4-903c-2eda6d7759c4 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:36.495637 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b445465-5556-44a4-903c-2eda6d7759c4 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:36.496360 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b445465-5556-44a4-903c-2eda6d7759c4 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:36.497121 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b445465-5556-44a4-903c-2eda6d7759c4 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:36.517035 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d2efa520-d28f-4540-bbf4-3153197dd193 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:36.518130 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d2efa520-d28f-4540-bbf4-3153197dd193 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:36.524530 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d2efa520-d28f-4540-bbf4-3153197dd193 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:36.525011 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d2efa520-d28f-4540-bbf4-3153197dd193 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:36.525726 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d2efa520-d28f-4540-bbf4-3153197dd193 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:36.526416 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d2efa520-d28f-4540-bbf4-3153197dd193 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:36.527021 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d2efa520-d28f-4540-bbf4-3153197dd193 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:36.527582 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d2efa520-d28f-4540-bbf4-3153197dd193 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:36.531789 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:14:36.709177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-8b445465-5556-44a4-903c-2eda6d7759c4 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:36.715746 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d2efa520-d28f-4540-bbf4-3153197dd193 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:36.724263 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8b445465-5556-44a4-903c-2eda6d7759c4 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1315 microversion: 2.1 time: 0.255825 Sep 04 16:14:36.724889 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 65/121] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:36 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:36.731544 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d2efa520-d28f-4540-bbf4-3153197dd193 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:36.731544 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d2efa520-d28f-4540-bbf4-3153197dd193 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:36.732804 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d2efa520-d28f-4540-bbf4-3153197dd193 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1407 microversion: 2.20 time: 0.220152 Sep 04 16:14:36.733353 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 57/122] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:36 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:14:37.343012 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1efae077-00a1-4b3d-b6f4-129ecfdbeccb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:37.348107 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ff55d7d7-9eb1-4700-8b3c-09f83eb808ee tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:37.355085 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ff55d7d7-9eb1-4700-8b3c-09f83eb808ee tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:37.355234 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1efae077-00a1-4b3d-b6f4-129ecfdbeccb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:37.363686 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff55d7d7-9eb1-4700-8b3c-09f83eb808ee tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:37.364173 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff55d7d7-9eb1-4700-8b3c-09f83eb808ee tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:37.364602 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff55d7d7-9eb1-4700-8b3c-09f83eb808ee tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:37.367918 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1efae077-00a1-4b3d-b6f4-129ecfdbeccb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:37.367918 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1efae077-00a1-4b3d-b6f4-129ecfdbeccb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:37.367918 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1efae077-00a1-4b3d-b6f4-129ecfdbeccb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:37.369094 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff55d7d7-9eb1-4700-8b3c-09f83eb808ee tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:37.369643 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff55d7d7-9eb1-4700-8b3c-09f83eb808ee tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:37.370395 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1efae077-00a1-4b3d-b6f4-129ecfdbeccb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:37.370978 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff55d7d7-9eb1-4700-8b3c-09f83eb808ee tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:37.371590 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1efae077-00a1-4b3d-b6f4-129ecfdbeccb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:37.377635 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1efae077-00a1-4b3d-b6f4-129ecfdbeccb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:37.634550 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ff55d7d7-9eb1-4700-8b3c-09f83eb808ee tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:37.644467 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ff55d7d7-9eb1-4700-8b3c-09f83eb808ee tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1367 microversion: 2.1 time: 0.300283 Sep 04 16:14:37.645363 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 58/123] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:37 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:37.660716 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1efae077-00a1-4b3d-b6f4-129ecfdbeccb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:37.668550 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1efae077-00a1-4b3d-b6f4-129ecfdbeccb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1321 microversion: 2.1 time: 0.330268 Sep 04 16:14:37.669127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 66/124] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:37 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:37.690948 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-927fb7e0-d28c-43e8-8a68-3545a58ddf80 req-08036cb7-3503-4166-b171-589d69252db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25192300-f22a-4b50-b390-17236f961eb5", "name": "network-vif-plugged", "status": "completed", "tag": "ea45359b-6df0-4bcb-9182-26e4cca9bdd6"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:14:37.702886 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-927fb7e0-d28c-43e8-8a68-3545a58ddf80 req-08036cb7-3503-4166-b171-589d69252db4 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:37.703697 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-927fb7e0-d28c-43e8-8a68-3545a58ddf80 req-08036cb7-3503-4166-b171-589d69252db4 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:37.704141 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-927fb7e0-d28c-43e8-8a68-3545a58ddf80 req-08036cb7-3503-4166-b171-589d69252db4 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:37.716509 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-927fb7e0-d28c-43e8-8a68-3545a58ddf80 req-08036cb7-3503-4166-b171-589d69252db4 service nova] Creating event network-vif-plugged:ea45359b-6df0-4bcb-9182-26e4cca9bdd6 for instance 25192300-f22a-4b50-b390-17236f961eb5 on hv-cinder-85236 Sep 04 16:14:37.722491 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-927fb7e0-d28c-43e8-8a68-3545a58ddf80 req-08036cb7-3503-4166-b171-589d69252db4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035805 Sep 04 16:14:37.723158 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 59/125] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:14:37.761200 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-af3bc3a5-e116-4bf0-a6cf-61c4dbe3b13d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:37.762708 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-af3bc3a5-e116-4bf0-a6cf-61c4dbe3b13d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:37.765263 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c6ffcbaa-3acc-4707-b1e9-d5b8ee2e5e12 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:37.769110 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c6ffcbaa-3acc-4707-b1e9-d5b8ee2e5e12 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:37.770174 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-af3bc3a5-e116-4bf0-a6cf-61c4dbe3b13d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:37.771071 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-af3bc3a5-e116-4bf0-a6cf-61c4dbe3b13d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:37.771978 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-af3bc3a5-e116-4bf0-a6cf-61c4dbe3b13d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:37.773136 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-af3bc3a5-e116-4bf0-a6cf-61c4dbe3b13d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:37.773807 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-af3bc3a5-e116-4bf0-a6cf-61c4dbe3b13d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:37.774409 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-af3bc3a5-e116-4bf0-a6cf-61c4dbe3b13d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:37.783999 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6ffcbaa-3acc-4707-b1e9-d5b8ee2e5e12 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:37.784498 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6ffcbaa-3acc-4707-b1e9-d5b8ee2e5e12 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:37.784934 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6ffcbaa-3acc-4707-b1e9-d5b8ee2e5e12 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:37.788821 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6ffcbaa-3acc-4707-b1e9-d5b8ee2e5e12 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:37.789478 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6ffcbaa-3acc-4707-b1e9-d5b8ee2e5e12 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:37.791495 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6ffcbaa-3acc-4707-b1e9-d5b8ee2e5e12 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:38.084207 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-af3bc3a5-e116-4bf0-a6cf-61c4dbe3b13d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:38.084207 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-af3bc3a5-e116-4bf0-a6cf-61c4dbe3b13d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:38.084454 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-af3bc3a5-e116-4bf0-a6cf-61c4dbe3b13d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:38.084454 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-af3bc3a5-e116-4bf0-a6cf-61c4dbe3b13d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1407 microversion: 2.20 time: 0.325115 Sep 04 16:14:38.084454 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 60/126] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:37 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1407 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:38.127908 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c6ffcbaa-3acc-4707-b1e9-d5b8ee2e5e12 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:38.135666 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c6ffcbaa-3acc-4707-b1e9-d5b8ee2e5e12 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1502 microversion: 2.1 time: 0.391861 Sep 04 16:14:38.149589 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 67/127] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:37 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1502 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:38.667901 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6fb36dfd-f56c-4de9-8c8c-a5fda0fe85a2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:38.668438 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6fb36dfd-f56c-4de9-8c8c-a5fda0fe85a2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:38.677081 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6fb36dfd-f56c-4de9-8c8c-a5fda0fe85a2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:38.677081 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6fb36dfd-f56c-4de9-8c8c-a5fda0fe85a2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:38.677081 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6fb36dfd-f56c-4de9-8c8c-a5fda0fe85a2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:38.677081 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6fb36dfd-f56c-4de9-8c8c-a5fda0fe85a2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:38.677496 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6fb36dfd-f56c-4de9-8c8c-a5fda0fe85a2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:38.677496 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6fb36dfd-f56c-4de9-8c8c-a5fda0fe85a2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:38.694737 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1fa019e2-f3ec-4e53-8fe4-82001dfb695f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:38.695345 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1fa019e2-f3ec-4e53-8fe4-82001dfb695f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:38.701464 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fa019e2-f3ec-4e53-8fe4-82001dfb695f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:38.701969 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fa019e2-f3ec-4e53-8fe4-82001dfb695f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:38.702403 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fa019e2-f3ec-4e53-8fe4-82001dfb695f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:38.703639 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fa019e2-f3ec-4e53-8fe4-82001dfb695f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:38.704092 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fa019e2-f3ec-4e53-8fe4-82001dfb695f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:38.704664 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1fa019e2-f3ec-4e53-8fe4-82001dfb695f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:38.882588 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6fb36dfd-f56c-4de9-8c8c-a5fda0fe85a2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:38.887750 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1fa019e2-f3ec-4e53-8fe4-82001dfb695f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:38.892413 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:14:38.893627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6fb36dfd-f56c-4de9-8c8c-a5fda0fe85a2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1367 microversion: 2.1 time: 0.229612 Sep 04 16:14:38.894288 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 61/128] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:38 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:38.896833 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1fa019e2-f3ec-4e53-8fe4-82001dfb695f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1321 microversion: 2.1 time: 0.205903 Sep 04 16:14:38.897392 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 68/129] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:38 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:39.110979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-55534ae0-8ab1-4f10-bc36-959de19341ee tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:39.111765 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-55534ae0-8ab1-4f10-bc36-959de19341ee tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:39.125705 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-55534ae0-8ab1-4f10-bc36-959de19341ee tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:39.127078 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-55534ae0-8ab1-4f10-bc36-959de19341ee tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:39.127078 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-55534ae0-8ab1-4f10-bc36-959de19341ee tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:39.127942 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-55534ae0-8ab1-4f10-bc36-959de19341ee tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:39.128397 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-55534ae0-8ab1-4f10-bc36-959de19341ee tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:39.128823 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-55534ae0-8ab1-4f10-bc36-959de19341ee tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:39.266869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-55534ae0-8ab1-4f10-bc36-959de19341ee tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:39.275190 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-55534ae0-8ab1-4f10-bc36-959de19341ee tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:39.276731 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-55534ae0-8ab1-4f10-bc36-959de19341ee tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:39.277951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-55534ae0-8ab1-4f10-bc36-959de19341ee tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1407 microversion: 2.20 time: 0.173155 Sep 04 16:14:39.278608 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 62/130] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:39 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:39.738173 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-4799cd71-fd2b-4ea3-8fa6-f8a15fdd5458 req-2cc86ab1-396a-4aed-9d8d-62fe920c36dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449c2258-280e-405f-a3d1-498688a52529", "name": "network-vif-plugged", "status": "completed", "tag": "34cf8243-0fd0-4c2f-b7aa-78222c3a9a6a"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:14:39.747671 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4799cd71-fd2b-4ea3-8fa6-f8a15fdd5458 req-2cc86ab1-396a-4aed-9d8d-62fe920c36dd service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:39.748138 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4799cd71-fd2b-4ea3-8fa6-f8a15fdd5458 req-2cc86ab1-396a-4aed-9d8d-62fe920c36dd service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:39.748546 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-4799cd71-fd2b-4ea3-8fa6-f8a15fdd5458 req-2cc86ab1-396a-4aed-9d8d-62fe920c36dd service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:39.760019 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-4799cd71-fd2b-4ea3-8fa6-f8a15fdd5458 req-2cc86ab1-396a-4aed-9d8d-62fe920c36dd service nova] Creating event network-vif-plugged:34cf8243-0fd0-4c2f-b7aa-78222c3a9a6a for instance 449c2258-280e-405f-a3d1-498688a52529 on hv-cinder-85236 Sep 04 16:14:39.766134 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-4799cd71-fd2b-4ea3-8fa6-f8a15fdd5458 req-2cc86ab1-396a-4aed-9d8d-62fe920c36dd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030864 Sep 04 16:14:39.766667 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 69/131] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:14:39.920544 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b4af6c3b-19a5-4f12-834c-226dcf7bb807 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:39.921199 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b4af6c3b-19a5-4f12-834c-226dcf7bb807 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:39.922794 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5d16d998-9f63-4956-801c-6f381345565d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:39.923838 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5d16d998-9f63-4956-801c-6f381345565d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:39.927867 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b4af6c3b-19a5-4f12-834c-226dcf7bb807 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:39.928349 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b4af6c3b-19a5-4f12-834c-226dcf7bb807 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:39.928782 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b4af6c3b-19a5-4f12-834c-226dcf7bb807 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:39.929470 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b4af6c3b-19a5-4f12-834c-226dcf7bb807 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:39.929947 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b4af6c3b-19a5-4f12-834c-226dcf7bb807 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:39.930234 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d16d998-9f63-4956-801c-6f381345565d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:39.930373 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b4af6c3b-19a5-4f12-834c-226dcf7bb807 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:39.930808 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d16d998-9f63-4956-801c-6f381345565d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:39.931241 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d16d998-9f63-4956-801c-6f381345565d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:39.931922 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d16d998-9f63-4956-801c-6f381345565d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:39.932367 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d16d998-9f63-4956-801c-6f381345565d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:39.932788 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5d16d998-9f63-4956-801c-6f381345565d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:40.137388 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b4af6c3b-19a5-4f12-834c-226dcf7bb807 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:40.142560 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5d16d998-9f63-4956-801c-6f381345565d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:40.148012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b4af6c3b-19a5-4f12-834c-226dcf7bb807 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1514 microversion: 2.1 time: 0.231405 Sep 04 16:14:40.148932 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 63/132] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:39 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1514 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:40.152795 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5d16d998-9f63-4956-801c-6f381345565d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1367 microversion: 2.1 time: 0.234621 Sep 04 16:14:40.159525 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 70/133] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:39 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:40.173041 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-49a7ab0f-da6d-4ba9-a743-4df4b87e71e1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:14:40.175541 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-49a7ab0f-da6d-4ba9-a743-4df4b87e71e1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:40.203526 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-49a7ab0f-da6d-4ba9-a743-4df4b87e71e1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:40.205536 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-49a7ab0f-da6d-4ba9-a743-4df4b87e71e1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:40.205536 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-49a7ab0f-da6d-4ba9-a743-4df4b87e71e1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:40.206137 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-49a7ab0f-da6d-4ba9-a743-4df4b87e71e1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:40.206596 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-49a7ab0f-da6d-4ba9-a743-4df4b87e71e1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:40.207018 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-49a7ab0f-da6d-4ba9-a743-4df4b87e71e1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:40.217620 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-246b979e-1458-49e8-a9d7-01dcb0041ae2 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "676c525c-eded-4943-9d91-3744b02ef622"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:14:40.222121 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-246b979e-1458-49e8-a9d7-01dcb0041ae2 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:40.230647 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-246b979e-1458-49e8-a9d7-01dcb0041ae2 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:40.231215 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-246b979e-1458-49e8-a9d7-01dcb0041ae2 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:40.231702 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-246b979e-1458-49e8-a9d7-01dcb0041ae2 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:40.232678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-246b979e-1458-49e8-a9d7-01dcb0041ae2 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:40.232952 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-246b979e-1458-49e8-a9d7-01dcb0041ae2 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:40.233460 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-246b979e-1458-49e8-a9d7-01dcb0041ae2 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:40.289065 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-49a7ab0f-da6d-4ba9-a743-4df4b87e71e1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lazy-loading 'flavor' on Instance uuid 9df07895-c9cb-4cee-93e7-1cafff31b091 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:14:40.647332 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-49a7ab0f-da6d-4ba9-a743-4df4b87e71e1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "POST /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091/action" status: 200 len: 32 microversion: 2.1 time: 0.478620 Sep 04 16:14:40.652891 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 64/134] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Sep 4 16:14:40 2022] POST /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091/action => generated 32 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 04 16:14:40.658130 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-bea553a9-3014-4a2a-8e4c-ef62e075fb20 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:40.659099 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-bea553a9-3014-4a2a-8e4c-ef62e075fb20 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:40.665599 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bea553a9-3014-4a2a-8e4c-ef62e075fb20 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:40.666207 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bea553a9-3014-4a2a-8e4c-ef62e075fb20 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:40.666734 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bea553a9-3014-4a2a-8e4c-ef62e075fb20 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:40.667529 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bea553a9-3014-4a2a-8e4c-ef62e075fb20 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:40.668131 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bea553a9-3014-4a2a-8e4c-ef62e075fb20 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:40.668632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bea553a9-3014-4a2a-8e4c-ef62e075fb20 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:40.817461 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bea553a9-3014-4a2a-8e4c-ef62e075fb20 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:40.825878 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bea553a9-3014-4a2a-8e4c-ef62e075fb20 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:40.827366 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bea553a9-3014-4a2a-8e4c-ef62e075fb20 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:40.828456 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-bea553a9-3014-4a2a-8e4c-ef62e075fb20 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1407 microversion: 2.20 time: 0.179447 Sep 04 16:14:40.829186 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 65/135] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:40 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:40.836227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-bc3e821e-f7ac-4e5b-9c50-628a21dee703 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:40.837217 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-bc3e821e-f7ac-4e5b-9c50-628a21dee703 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:40.843489 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bc3e821e-f7ac-4e5b-9c50-628a21dee703 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:40.844045 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bc3e821e-f7ac-4e5b-9c50-628a21dee703 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:40.844371 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bc3e821e-f7ac-4e5b-9c50-628a21dee703 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:40.846625 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bc3e821e-f7ac-4e5b-9c50-628a21dee703 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:40.846625 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bc3e821e-f7ac-4e5b-9c50-628a21dee703 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:40.846625 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bc3e821e-f7ac-4e5b-9c50-628a21dee703 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:40.994674 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bc3e821e-f7ac-4e5b-9c50-628a21dee703 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:41.003000 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-bc3e821e-f7ac-4e5b-9c50-628a21dee703 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.172829 Sep 04 16:14:41.003574 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 66/136] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:40 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:41.176820 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4c55687a-f202-4585-aa6a-4c4b0d97b4bf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:41.177424 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4c55687a-f202-4585-aa6a-4c4b0d97b4bf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:41.183349 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c55687a-f202-4585-aa6a-4c4b0d97b4bf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:41.183827 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c55687a-f202-4585-aa6a-4c4b0d97b4bf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:41.184256 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c55687a-f202-4585-aa6a-4c4b0d97b4bf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:41.184938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c55687a-f202-4585-aa6a-4c4b0d97b4bf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:41.185387 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c55687a-f202-4585-aa6a-4c4b0d97b4bf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:41.185896 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c55687a-f202-4585-aa6a-4c4b0d97b4bf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:41.320278 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4c55687a-f202-4585-aa6a-4c4b0d97b4bf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:41.328696 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4c55687a-f202-4585-aa6a-4c4b0d97b4bf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1367 microversion: 2.1 time: 0.156167 Sep 04 16:14:41.329419 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 67/137] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:41 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:41.856636 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0fe5d79e-e04b-438c-bcbb-9c28486e2665 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:41.857240 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0fe5d79e-e04b-438c-bcbb-9c28486e2665 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:41.864236 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0fe5d79e-e04b-438c-bcbb-9c28486e2665 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:41.864716 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0fe5d79e-e04b-438c-bcbb-9c28486e2665 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:41.865153 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0fe5d79e-e04b-438c-bcbb-9c28486e2665 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:41.865867 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0fe5d79e-e04b-438c-bcbb-9c28486e2665 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:41.866321 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0fe5d79e-e04b-438c-bcbb-9c28486e2665 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:41.866740 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0fe5d79e-e04b-438c-bcbb-9c28486e2665 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:42.023371 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0fe5d79e-e04b-438c-bcbb-9c28486e2665 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:42.034185 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0fe5d79e-e04b-438c-bcbb-9c28486e2665 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:42.035936 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0fe5d79e-e04b-438c-bcbb-9c28486e2665 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:42.037206 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0fe5d79e-e04b-438c-bcbb-9c28486e2665 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1407 microversion: 2.20 time: 0.184493 Sep 04 16:14:42.038240 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 68/138] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:41 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:42.042937 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e869f1b9-e5f0-4818-ad3e-0166bba355ef tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:42.043530 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e869f1b9-e5f0-4818-ad3e-0166bba355ef tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:42.049504 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e869f1b9-e5f0-4818-ad3e-0166bba355ef tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:42.050031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e869f1b9-e5f0-4818-ad3e-0166bba355ef tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:42.050655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e869f1b9-e5f0-4818-ad3e-0166bba355ef tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:42.051337 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e869f1b9-e5f0-4818-ad3e-0166bba355ef tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:42.051779 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e869f1b9-e5f0-4818-ad3e-0166bba355ef tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:42.052188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e869f1b9-e5f0-4818-ad3e-0166bba355ef tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:42.183277 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e869f1b9-e5f0-4818-ad3e-0166bba355ef tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:42.191681 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e869f1b9-e5f0-4818-ad3e-0166bba355ef tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.152161 Sep 04 16:14:42.192463 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 69/139] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:42 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:42.355991 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1d2e3e6e-9279-4fdf-bab2-7cb7f159175f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:42.356585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1d2e3e6e-9279-4fdf-bab2-7cb7f159175f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:42.363095 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1d2e3e6e-9279-4fdf-bab2-7cb7f159175f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:42.363640 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1d2e3e6e-9279-4fdf-bab2-7cb7f159175f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:42.364057 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1d2e3e6e-9279-4fdf-bab2-7cb7f159175f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:42.364735 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1d2e3e6e-9279-4fdf-bab2-7cb7f159175f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:42.371002 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1d2e3e6e-9279-4fdf-bab2-7cb7f159175f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:42.371002 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1d2e3e6e-9279-4fdf-bab2-7cb7f159175f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:42.517607 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1d2e3e6e-9279-4fdf-bab2-7cb7f159175f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:42.535512 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1d2e3e6e-9279-4fdf-bab2-7cb7f159175f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1367 microversion: 2.1 time: 0.183417 Sep 04 16:14:42.536107 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 70/140] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:42 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:43.064532 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2c74776e-8529-4960-900e-7fabf991b4c5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:43.065187 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2c74776e-8529-4960-900e-7fabf991b4c5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:43.068484 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:14:43.072037 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2c74776e-8529-4960-900e-7fabf991b4c5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:43.072579 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2c74776e-8529-4960-900e-7fabf991b4c5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:43.073189 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2c74776e-8529-4960-900e-7fabf991b4c5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:43.074041 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2c74776e-8529-4960-900e-7fabf991b4c5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:43.074553 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2c74776e-8529-4960-900e-7fabf991b4c5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:43.075055 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2c74776e-8529-4960-900e-7fabf991b4c5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:43.231912 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2c74776e-8529-4960-900e-7fabf991b4c5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:43.240697 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2c74776e-8529-4960-900e-7fabf991b4c5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:43.242441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2c74776e-8529-4960-900e-7fabf991b4c5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:43.243934 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2c74776e-8529-4960-900e-7fabf991b4c5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1407 microversion: 2.20 time: 0.184932 Sep 04 16:14:43.244579 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 71/141] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:43 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:14:43.270423 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fc56dc7d-d13c-4222-af07-1c5367a404d3 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:43.271043 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fc56dc7d-d13c-4222-af07-1c5367a404d3 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:43.278025 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc56dc7d-d13c-4222-af07-1c5367a404d3 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:43.278149 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc56dc7d-d13c-4222-af07-1c5367a404d3 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:43.278595 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc56dc7d-d13c-4222-af07-1c5367a404d3 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:43.279278 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc56dc7d-d13c-4222-af07-1c5367a404d3 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:43.279728 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc56dc7d-d13c-4222-af07-1c5367a404d3 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:43.280146 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc56dc7d-d13c-4222-af07-1c5367a404d3 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:43.433239 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fc56dc7d-d13c-4222-af07-1c5367a404d3 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:43.462622 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fc56dc7d-d13c-4222-af07-1c5367a404d3 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.202282 Sep 04 16:14:43.462622 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 72/142] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:43 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:43.560124 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2d41b50b-3bbb-4391-a769-c49df7c11dce tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:43.560705 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2d41b50b-3bbb-4391-a769-c49df7c11dce tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:43.567357 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2d41b50b-3bbb-4391-a769-c49df7c11dce tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:43.567827 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2d41b50b-3bbb-4391-a769-c49df7c11dce tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:43.573270 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2d41b50b-3bbb-4391-a769-c49df7c11dce tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:43.573270 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2d41b50b-3bbb-4391-a769-c49df7c11dce tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:43.573270 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2d41b50b-3bbb-4391-a769-c49df7c11dce tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:43.573270 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2d41b50b-3bbb-4391-a769-c49df7c11dce tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:43.704417 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2d41b50b-3bbb-4391-a769-c49df7c11dce tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:43.711951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2d41b50b-3bbb-4391-a769-c49df7c11dce tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1367 microversion: 2.1 time: 0.156004 Sep 04 16:14:43.712740 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 73/143] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:43 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:44.269838 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-35fa3bcf-a0b4-45b9-a054-bd963bfbd8cc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:44.270451 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-35fa3bcf-a0b4-45b9-a054-bd963bfbd8cc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:44.276350 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-35fa3bcf-a0b4-45b9-a054-bd963bfbd8cc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:44.276818 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-35fa3bcf-a0b4-45b9-a054-bd963bfbd8cc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:44.277245 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-35fa3bcf-a0b4-45b9-a054-bd963bfbd8cc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:44.277942 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-35fa3bcf-a0b4-45b9-a054-bd963bfbd8cc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:44.278385 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-35fa3bcf-a0b4-45b9-a054-bd963bfbd8cc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:44.278795 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-35fa3bcf-a0b4-45b9-a054-bd963bfbd8cc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:44.409200 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-35fa3bcf-a0b4-45b9-a054-bd963bfbd8cc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:44.417617 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-35fa3bcf-a0b4-45b9-a054-bd963bfbd8cc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:44.419054 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-35fa3bcf-a0b4-45b9-a054-bd963bfbd8cc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:44.420387 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-35fa3bcf-a0b4-45b9-a054-bd963bfbd8cc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1599 microversion: 2.20 time: 0.155093 Sep 04 16:14:44.421185 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 74/144] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:14:44 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:14:44.451367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e976c4f3-2f17-44ff-b210-5318633899a9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:44.451850 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e976c4f3-2f17-44ff-b210-5318633899a9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:44.458398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e976c4f3-2f17-44ff-b210-5318633899a9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:44.458870 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e976c4f3-2f17-44ff-b210-5318633899a9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:44.459294 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e976c4f3-2f17-44ff-b210-5318633899a9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:44.460001 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e976c4f3-2f17-44ff-b210-5318633899a9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:44.460444 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e976c4f3-2f17-44ff-b210-5318633899a9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:44.460855 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e976c4f3-2f17-44ff-b210-5318633899a9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:44.541334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e976c4f3-2f17-44ff-b210-5318633899a9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093705 Sep 04 16:14:44.541973 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 75/145] 10.222.0.39 () {60 vars in 1316 bytes} [Sun Sep 4 16:14:44 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 04 16:14:44.546692 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d8b43727-d37c-45e3-bf29-19ca776ab9a4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:44.547277 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d8b43727-d37c-45e3-bf29-19ca776ab9a4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:44.553445 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d8b43727-d37c-45e3-bf29-19ca776ab9a4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:44.553958 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d8b43727-d37c-45e3-bf29-19ca776ab9a4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:44.554384 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d8b43727-d37c-45e3-bf29-19ca776ab9a4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:44.555064 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d8b43727-d37c-45e3-bf29-19ca776ab9a4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:44.555507 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d8b43727-d37c-45e3-bf29-19ca776ab9a4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:44.555920 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d8b43727-d37c-45e3-bf29-19ca776ab9a4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:44.684100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d8b43727-d37c-45e3-bf29-19ca776ab9a4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:44.690855 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:14:44.693543 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d8b43727-d37c-45e3-bf29-19ca776ab9a4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.150481 Sep 04 16:14:44.694154 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 76/146] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:44 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:44.744056 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-099fa748-15f6-4b9e-b645-8762be1934f5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:44.744677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-099fa748-15f6-4b9e-b645-8762be1934f5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:44.751808 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-099fa748-15f6-4b9e-b645-8762be1934f5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:44.752300 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-099fa748-15f6-4b9e-b645-8762be1934f5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:44.752734 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-099fa748-15f6-4b9e-b645-8762be1934f5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:44.753602 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-099fa748-15f6-4b9e-b645-8762be1934f5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:44.754079 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-099fa748-15f6-4b9e-b645-8762be1934f5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:44.754503 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-099fa748-15f6-4b9e-b645-8762be1934f5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:44.953380 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-099fa748-15f6-4b9e-b645-8762be1934f5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:44.961990 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-099fa748-15f6-4b9e-b645-8762be1934f5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1367 microversion: 2.1 time: 0.227322 Sep 04 16:14:44.962573 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 77/147] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:44 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:45.716532 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-73790f83-cd36-4774-8a73-622257ad516f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:45.717193 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-73790f83-cd36-4774-8a73-622257ad516f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:45.723162 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-73790f83-cd36-4774-8a73-622257ad516f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:45.723637 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-73790f83-cd36-4774-8a73-622257ad516f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:45.724071 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-73790f83-cd36-4774-8a73-622257ad516f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:45.724763 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-73790f83-cd36-4774-8a73-622257ad516f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:45.725214 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-73790f83-cd36-4774-8a73-622257ad516f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:45.725744 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-73790f83-cd36-4774-8a73-622257ad516f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:45.855459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-73790f83-cd36-4774-8a73-622257ad516f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:45.863959 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-73790f83-cd36-4774-8a73-622257ad516f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.151445 Sep 04 16:14:45.864576 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 78/148] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:45 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:45.986160 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b4e151a6-d949-42db-b998-63c8c215c733 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:45.991402 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b4e151a6-d949-42db-b998-63c8c215c733 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:45.992927 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b4e151a6-d949-42db-b998-63c8c215c733 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:45.993406 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b4e151a6-d949-42db-b998-63c8c215c733 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:45.993872 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b4e151a6-d949-42db-b998-63c8c215c733 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:45.994548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b4e151a6-d949-42db-b998-63c8c215c733 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:45.994992 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b4e151a6-d949-42db-b998-63c8c215c733 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:45.995403 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b4e151a6-d949-42db-b998-63c8c215c733 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:46.159028 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b4e151a6-d949-42db-b998-63c8c215c733 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:46.168424 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b4e151a6-d949-42db-b998-63c8c215c733 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1367 microversion: 2.1 time: 0.186503 Sep 04 16:14:46.168986 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 79/149] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:45 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:46.179944 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-f683cca2-00cf-48bc-b5dd-8b1169d0338a req-92f74477-1e86-4728-88f8-0d077c70ad2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25192300-f22a-4b50-b390-17236f961eb5", "tag": "ea45359b-6df0-4bcb-9182-26e4cca9bdd6"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:14:46.192472 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-f683cca2-00cf-48bc-b5dd-8b1169d0338a req-92f74477-1e86-4728-88f8-0d077c70ad2d service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:46.192472 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-f683cca2-00cf-48bc-b5dd-8b1169d0338a req-92f74477-1e86-4728-88f8-0d077c70ad2d service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:46.192472 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-f683cca2-00cf-48bc-b5dd-8b1169d0338a req-92f74477-1e86-4728-88f8-0d077c70ad2d service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:46.206335 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-f683cca2-00cf-48bc-b5dd-8b1169d0338a req-92f74477-1e86-4728-88f8-0d077c70ad2d service nova] Creating event network-changed:ea45359b-6df0-4bcb-9182-26e4cca9bdd6 for instance 25192300-f22a-4b50-b390-17236f961eb5 on hv-cinder-85236 Sep 04 16:14:46.213850 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-f683cca2-00cf-48bc-b5dd-8b1169d0338a req-92f74477-1e86-4728-88f8-0d077c70ad2d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042739 Sep 04 16:14:46.217325 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 80/150] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:14:46.888572 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8a8f38e4-2da3-49c5-b2d3-3a10ba149389 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:46.890205 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8a8f38e4-2da3-49c5-b2d3-3a10ba149389 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:46.897030 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8a8f38e4-2da3-49c5-b2d3-3a10ba149389 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:46.897876 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8a8f38e4-2da3-49c5-b2d3-3a10ba149389 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:46.898566 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8a8f38e4-2da3-49c5-b2d3-3a10ba149389 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:46.899531 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8a8f38e4-2da3-49c5-b2d3-3a10ba149389 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:46.900196 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8a8f38e4-2da3-49c5-b2d3-3a10ba149389 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:46.900832 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8a8f38e4-2da3-49c5-b2d3-3a10ba149389 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:47.290551 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-246b979e-1458-49e8-a9d7-01dcb0041ae2 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "POST /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.077678 Sep 04 16:14:47.295167 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 71/151] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Sep 4 16:14:40 2022] POST /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d/os-volume_attachments => generated 194 bytes in 7080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:14:47.297871 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-019783a1-f18a-4308-a40a-6a820815fea1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:47.300864 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-019783a1-f18a-4308-a40a-6a820815fea1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:47.302990 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=85 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:14:47.308550 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-019783a1-f18a-4308-a40a-6a820815fea1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:47.309098 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-019783a1-f18a-4308-a40a-6a820815fea1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:47.309542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-019783a1-f18a-4308-a40a-6a820815fea1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:47.310468 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-019783a1-f18a-4308-a40a-6a820815fea1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:47.311088 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-019783a1-f18a-4308-a40a-6a820815fea1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:47.311387 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-019783a1-f18a-4308-a40a-6a820815fea1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:47.358010 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8a8f38e4-2da3-49c5-b2d3-3a10ba149389 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:47.367372 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8a8f38e4-2da3-49c5-b2d3-3a10ba149389 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.483293 Sep 04 16:14:47.372679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 81/152] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:46 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:47.579759 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-019783a1-f18a-4308-a40a-6a820815fea1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:47.593308 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-019783a1-f18a-4308-a40a-6a820815fea1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1367 microversion: 2.1 time: 0.300365 Sep 04 16:14:47.595220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 72/153] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:47 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:48.391748 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1fd520b3-f211-4a94-bf43-313d123eee08 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:48.392349 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1fd520b3-f211-4a94-bf43-313d123eee08 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:48.398387 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1fd520b3-f211-4a94-bf43-313d123eee08 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:48.398869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1fd520b3-f211-4a94-bf43-313d123eee08 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:48.399352 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1fd520b3-f211-4a94-bf43-313d123eee08 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:48.400056 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1fd520b3-f211-4a94-bf43-313d123eee08 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:48.400496 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1fd520b3-f211-4a94-bf43-313d123eee08 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:48.400915 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1fd520b3-f211-4a94-bf43-313d123eee08 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:48.617284 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d883802c-3486-48ba-a207-5451aebeafa3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:48.617916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d883802c-3486-48ba-a207-5451aebeafa3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:48.626502 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d883802c-3486-48ba-a207-5451aebeafa3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:48.626996 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d883802c-3486-48ba-a207-5451aebeafa3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:48.627431 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d883802c-3486-48ba-a207-5451aebeafa3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:48.628280 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d883802c-3486-48ba-a207-5451aebeafa3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:48.628637 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d883802c-3486-48ba-a207-5451aebeafa3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:48.629053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d883802c-3486-48ba-a207-5451aebeafa3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:48.660568 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1fd520b3-f211-4a94-bf43-313d123eee08 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:48.668289 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1fd520b3-f211-4a94-bf43-313d123eee08 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.281155 Sep 04 16:14:48.668861 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 82/154] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:48 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:49.067360 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d883802c-3486-48ba-a207-5451aebeafa3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:49.073703 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d883802c-3486-48ba-a207-5451aebeafa3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1367 microversion: 2.1 time: 0.460294 Sep 04 16:14:49.074319 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 73/155] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:48 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1367 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:49.691048 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e66a0da3-cc45-4a73-90b5-4403f5c1cc72 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:49.692397 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e66a0da3-cc45-4a73-90b5-4403f5c1cc72 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:49.698417 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e66a0da3-cc45-4a73-90b5-4403f5c1cc72 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:49.698902 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e66a0da3-cc45-4a73-90b5-4403f5c1cc72 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:49.699332 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e66a0da3-cc45-4a73-90b5-4403f5c1cc72 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:49.700056 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e66a0da3-cc45-4a73-90b5-4403f5c1cc72 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:49.700506 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e66a0da3-cc45-4a73-90b5-4403f5c1cc72 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:49.700924 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e66a0da3-cc45-4a73-90b5-4403f5c1cc72 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:49.843210 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e66a0da3-cc45-4a73-90b5-4403f5c1cc72 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:49.852163 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e66a0da3-cc45-4a73-90b5-4403f5c1cc72 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.164994 Sep 04 16:14:49.852728 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 83/156] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:49 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:50.097949 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-86ebfac1-0c3a-47b5-aac4-9a39b69d1519 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:50.098589 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-86ebfac1-0c3a-47b5-aac4-9a39b69d1519 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:50.105415 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86ebfac1-0c3a-47b5-aac4-9a39b69d1519 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:50.105921 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86ebfac1-0c3a-47b5-aac4-9a39b69d1519 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:50.106354 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86ebfac1-0c3a-47b5-aac4-9a39b69d1519 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:50.107022 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86ebfac1-0c3a-47b5-aac4-9a39b69d1519 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:50.107460 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86ebfac1-0c3a-47b5-aac4-9a39b69d1519 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:50.107873 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-86ebfac1-0c3a-47b5-aac4-9a39b69d1519 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:50.236838 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-86ebfac1-0c3a-47b5-aac4-9a39b69d1519 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:50.244341 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-86ebfac1-0c3a-47b5-aac4-9a39b69d1519 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1558 microversion: 2.1 time: 0.150327 Sep 04 16:14:50.244956 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 74/157] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:50 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:50.269948 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f48187cf-4d2c-468e-a2a7-e908ec3f58e3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:50.270490 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f48187cf-4d2c-468e-a2a7-e908ec3f58e3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:50.276988 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f48187cf-4d2c-468e-a2a7-e908ec3f58e3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:50.277249 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f48187cf-4d2c-468e-a2a7-e908ec3f58e3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:50.277764 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f48187cf-4d2c-468e-a2a7-e908ec3f58e3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:50.278385 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f48187cf-4d2c-468e-a2a7-e908ec3f58e3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:50.278841 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f48187cf-4d2c-468e-a2a7-e908ec3f58e3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:50.279257 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f48187cf-4d2c-468e-a2a7-e908ec3f58e3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:50.367732 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f48187cf-4d2c-468e-a2a7-e908ec3f58e3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102667 Sep 04 16:14:50.368329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 84/158] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Sep 4 16:14:50 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:14:50.881624 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cc14d886-c469-4e75-9897-606e36bfa6b4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:50.882855 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cc14d886-c469-4e75-9897-606e36bfa6b4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:50.890859 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc14d886-c469-4e75-9897-606e36bfa6b4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:50.894742 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc14d886-c469-4e75-9897-606e36bfa6b4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:50.894742 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc14d886-c469-4e75-9897-606e36bfa6b4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:50.894742 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc14d886-c469-4e75-9897-606e36bfa6b4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:50.894742 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc14d886-c469-4e75-9897-606e36bfa6b4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:50.895182 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cc14d886-c469-4e75-9897-606e36bfa6b4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:51.071109 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-cc14d886-c469-4e75-9897-606e36bfa6b4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:51.081509 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cc14d886-c469-4e75-9897-606e36bfa6b4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.208238 Sep 04 16:14:51.082485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 75/159] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:50 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:51.644401 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-2ceebc53-c438-4e26-af81-a3b65663079a req-d6256a75-7623-4eda-b369-76b99abdaccd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "449c2258-280e-405f-a3d1-498688a52529", "tag": "34cf8243-0fd0-4c2f-b7aa-78222c3a9a6a"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:14:51.658555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-2ceebc53-c438-4e26-af81-a3b65663079a req-d6256a75-7623-4eda-b369-76b99abdaccd service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:51.659345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-2ceebc53-c438-4e26-af81-a3b65663079a req-d6256a75-7623-4eda-b369-76b99abdaccd service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:51.659910 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-2ceebc53-c438-4e26-af81-a3b65663079a req-d6256a75-7623-4eda-b369-76b99abdaccd service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:51.675727 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-2ceebc53-c438-4e26-af81-a3b65663079a req-d6256a75-7623-4eda-b369-76b99abdaccd service nova] Creating event network-changed:34cf8243-0fd0-4c2f-b7aa-78222c3a9a6a for instance 449c2258-280e-405f-a3d1-498688a52529 on hv-cinder-85236 Sep 04 16:14:51.682309 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-2ceebc53-c438-4e26-af81-a3b65663079a req-d6256a75-7623-4eda-b369-76b99abdaccd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041828 Sep 04 16:14:51.683863 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 85/160] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:14:52.112374 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0f83a8fe-f626-4089-9961-8e946773061e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:52.113025 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0f83a8fe-f626-4089-9961-8e946773061e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:52.119944 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f83a8fe-f626-4089-9961-8e946773061e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:52.120780 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f83a8fe-f626-4089-9961-8e946773061e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:52.122191 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f83a8fe-f626-4089-9961-8e946773061e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:52.123232 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f83a8fe-f626-4089-9961-8e946773061e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:52.123947 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f83a8fe-f626-4089-9961-8e946773061e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:52.125211 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f83a8fe-f626-4089-9961-8e946773061e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:52.441146 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0f83a8fe-f626-4089-9961-8e946773061e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:52.449113 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0f83a8fe-f626-4089-9961-8e946773061e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.341724 Sep 04 16:14:52.450365 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 76/161] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:52 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:53.477965 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b0e7a633-6393-43d7-ae6a-1b814f57479a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:53.479521 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b0e7a633-6393-43d7-ae6a-1b814f57479a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:53.487818 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0e7a633-6393-43d7-ae6a-1b814f57479a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:53.488698 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0e7a633-6393-43d7-ae6a-1b814f57479a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:53.489767 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0e7a633-6393-43d7-ae6a-1b814f57479a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:53.490661 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0e7a633-6393-43d7-ae6a-1b814f57479a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:53.491262 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0e7a633-6393-43d7-ae6a-1b814f57479a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:53.491888 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0e7a633-6393-43d7-ae6a-1b814f57479a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:53.651739 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b0e7a633-6393-43d7-ae6a-1b814f57479a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:53.660499 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b0e7a633-6393-43d7-ae6a-1b814f57479a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.187072 Sep 04 16:14:53.661307 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 86/162] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:53 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:54.683291 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-843ae6c4-5e90-472c-ae1e-44914dd9da3d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:54.683891 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-843ae6c4-5e90-472c-ae1e-44914dd9da3d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:54.691172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-843ae6c4-5e90-472c-ae1e-44914dd9da3d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:54.691874 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-843ae6c4-5e90-472c-ae1e-44914dd9da3d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:54.692309 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-843ae6c4-5e90-472c-ae1e-44914dd9da3d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:54.697473 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-843ae6c4-5e90-472c-ae1e-44914dd9da3d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:54.697473 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-843ae6c4-5e90-472c-ae1e-44914dd9da3d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:54.697473 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-843ae6c4-5e90-472c-ae1e-44914dd9da3d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:54.837308 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-843ae6c4-5e90-472c-ae1e-44914dd9da3d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:54.845493 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-843ae6c4-5e90-472c-ae1e-44914dd9da3d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.165913 Sep 04 16:14:54.846105 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 77/163] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:54 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:55.869125 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d10c1ad7-b1d0-48a9-a3e7-f4c0df1e6e6e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:55.869924 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d10c1ad7-b1d0-48a9-a3e7-f4c0df1e6e6e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:55.876082 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d10c1ad7-b1d0-48a9-a3e7-f4c0df1e6e6e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:55.876643 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d10c1ad7-b1d0-48a9-a3e7-f4c0df1e6e6e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:55.877157 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d10c1ad7-b1d0-48a9-a3e7-f4c0df1e6e6e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:55.877971 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d10c1ad7-b1d0-48a9-a3e7-f4c0df1e6e6e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:55.878497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d10c1ad7-b1d0-48a9-a3e7-f4c0df1e6e6e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:55.879010 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d10c1ad7-b1d0-48a9-a3e7-f4c0df1e6e6e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:56.010523 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d10c1ad7-b1d0-48a9-a3e7-f4c0df1e6e6e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:56.020820 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d10c1ad7-b1d0-48a9-a3e7-f4c0df1e6e6e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.155325 Sep 04 16:14:56.021676 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 87/164] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:55 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:57.044336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a597ec3c-8fe1-462f-88d0-0abe51e70577 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:57.044951 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a597ec3c-8fe1-462f-88d0-0abe51e70577 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:57.053105 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a597ec3c-8fe1-462f-88d0-0abe51e70577 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:57.057254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a597ec3c-8fe1-462f-88d0-0abe51e70577 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:57.057254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a597ec3c-8fe1-462f-88d0-0abe51e70577 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:57.057254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a597ec3c-8fe1-462f-88d0-0abe51e70577 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:57.057254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a597ec3c-8fe1-462f-88d0-0abe51e70577 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:57.057757 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a597ec3c-8fe1-462f-88d0-0abe51e70577 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:57.199269 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a597ec3c-8fe1-462f-88d0-0abe51e70577 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:57.219086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a597ec3c-8fe1-462f-88d0-0abe51e70577 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.168484 Sep 04 16:14:57.219086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 78/165] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:57 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:58.233001 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8115af7f-b79f-491e-8719-c50653482f1f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:58.234008 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8115af7f-b79f-491e-8719-c50653482f1f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:58.240541 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8115af7f-b79f-491e-8719-c50653482f1f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:58.241098 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8115af7f-b79f-491e-8719-c50653482f1f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:58.241644 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8115af7f-b79f-491e-8719-c50653482f1f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:58.242545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8115af7f-b79f-491e-8719-c50653482f1f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:58.243187 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8115af7f-b79f-491e-8719-c50653482f1f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:58.243967 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8115af7f-b79f-491e-8719-c50653482f1f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:58.417847 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d4c04adc-3474-4701-91ec-b0ca4ecf657a tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:58.418352 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d4c04adc-3474-4701-91ec-b0ca4ecf657a tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:58.429074 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4c04adc-3474-4701-91ec-b0ca4ecf657a tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:58.429763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4c04adc-3474-4701-91ec-b0ca4ecf657a tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:58.431469 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4c04adc-3474-4701-91ec-b0ca4ecf657a tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:58.431469 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4c04adc-3474-4701-91ec-b0ca4ecf657a tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:58.431469 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4c04adc-3474-4701-91ec-b0ca4ecf657a tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:58.432057 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d4c04adc-3474-4701-91ec-b0ca4ecf657a tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:58.439619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8115af7f-b79f-491e-8719-c50653482f1f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:58.448949 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8115af7f-b79f-491e-8719-c50653482f1f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.218232 Sep 04 16:14:58.451171 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 88/166] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:58 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:14:58.471974 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d4c04adc-3474-4701-91ec-b0ca4ecf657a tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 16:14:58.608954 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:14:58.807658 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d4c04adc-3474-4701-91ec-b0ca4ecf657a tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 204 len: 0 microversion: 2.1 time: 0.393793 Sep 04 16:14:58.817086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 79/167] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:14:58 2022] DELETE /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 16:14:58.823276 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-702114ba-a8f1-4978-991b-9af67214701b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:58.824132 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-702114ba-a8f1-4978-991b-9af67214701b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:58.836116 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-702114ba-a8f1-4978-991b-9af67214701b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:58.838129 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-702114ba-a8f1-4978-991b-9af67214701b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:58.842382 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-702114ba-a8f1-4978-991b-9af67214701b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:58.842382 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-702114ba-a8f1-4978-991b-9af67214701b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:58.842382 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-702114ba-a8f1-4978-991b-9af67214701b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:58.842382 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-702114ba-a8f1-4978-991b-9af67214701b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:59.019975 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-702114ba-a8f1-4978-991b-9af67214701b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:59.030747 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-702114ba-a8f1-4978-991b-9af67214701b tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1554 microversion: 2.1 time: 0.212680 Sep 04 16:14:59.032409 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 89/168] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:58 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1554 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:14:59.473927 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5555efae-c563-49a7-8887-2df945fa7554 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:14:59.474659 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5555efae-c563-49a7-8887-2df945fa7554 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:14:59.482662 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5555efae-c563-49a7-8887-2df945fa7554 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:59.483143 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5555efae-c563-49a7-8887-2df945fa7554 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:59.483582 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5555efae-c563-49a7-8887-2df945fa7554 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:59.484636 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5555efae-c563-49a7-8887-2df945fa7554 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:14:59.485135 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5555efae-c563-49a7-8887-2df945fa7554 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:14:59.485612 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5555efae-c563-49a7-8887-2df945fa7554 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:14:59.626362 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5555efae-c563-49a7-8887-2df945fa7554 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:14:59.636099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5555efae-c563-49a7-8887-2df945fa7554 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.166250 Sep 04 16:14:59.637413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 80/169] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:14:59 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:00.054801 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-60ed3f37-5e6a-4043-9daf-56e0d70e5256 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:00.055565 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-60ed3f37-5e6a-4043-9daf-56e0d70e5256 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:00.062570 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-60ed3f37-5e6a-4043-9daf-56e0d70e5256 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:00.063877 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-60ed3f37-5e6a-4043-9daf-56e0d70e5256 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:00.063877 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-60ed3f37-5e6a-4043-9daf-56e0d70e5256 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:00.064636 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-60ed3f37-5e6a-4043-9daf-56e0d70e5256 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:00.065090 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-60ed3f37-5e6a-4043-9daf-56e0d70e5256 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:00.065504 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-60ed3f37-5e6a-4043-9daf-56e0d70e5256 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:00.207113 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-60ed3f37-5e6a-4043-9daf-56e0d70e5256 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:00.215409 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-60ed3f37-5e6a-4043-9daf-56e0d70e5256 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1554 microversion: 2.1 time: 0.164569 Sep 04 16:15:00.216171 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 90/170] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:00 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:00.660542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-291f5d25-8d60-4e11-a591-695cfc10c1a5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:00.661409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-291f5d25-8d60-4e11-a591-695cfc10c1a5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:00.669120 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-291f5d25-8d60-4e11-a591-695cfc10c1a5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:00.669713 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-291f5d25-8d60-4e11-a591-695cfc10c1a5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:00.670240 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-291f5d25-8d60-4e11-a591-695cfc10c1a5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:00.671001 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-291f5d25-8d60-4e11-a591-695cfc10c1a5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:00.671605 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-291f5d25-8d60-4e11-a591-695cfc10c1a5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:00.672033 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-291f5d25-8d60-4e11-a591-695cfc10c1a5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:00.816674 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-291f5d25-8d60-4e11-a591-695cfc10c1a5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:00.825696 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-291f5d25-8d60-4e11-a591-695cfc10c1a5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.168978 Sep 04 16:15:00.826390 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 81/171] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:00 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:01.239295 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7b304019-fe08-45e6-a2c4-9996e0f59d44 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:01.239993 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7b304019-fe08-45e6-a2c4-9996e0f59d44 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:01.247201 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7b304019-fe08-45e6-a2c4-9996e0f59d44 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:01.247687 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7b304019-fe08-45e6-a2c4-9996e0f59d44 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:01.248119 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7b304019-fe08-45e6-a2c4-9996e0f59d44 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:01.248813 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7b304019-fe08-45e6-a2c4-9996e0f59d44 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:01.249453 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7b304019-fe08-45e6-a2c4-9996e0f59d44 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:01.250050 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7b304019-fe08-45e6-a2c4-9996e0f59d44 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:01.387909 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7b304019-fe08-45e6-a2c4-9996e0f59d44 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:01.401143 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7b304019-fe08-45e6-a2c4-9996e0f59d44 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1554 microversion: 2.1 time: 0.161474 Sep 04 16:15:01.401143 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 91/172] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:01 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:15:01.776719 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b4915a54-016f-4cd1-bf9c-4fae4a88e156 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1700190378", "imageRef": "11a460f6-29b0-46e6-ae98-e53ee2e13520", "flavorRef": "452", "networks": [{"uuid": "9dd59a90-1b88-4c82-b79b-5c099bf25a16"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:15:01.850486 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8e15af89-658b-4832-a051-ef061357fb70 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:01.851210 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8e15af89-658b-4832-a051-ef061357fb70 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:01.856126 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-b4915a54-016f-4cd1-bf9c-4fae4a88e156 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] validate_networks() for [('9dd59a90-1b88-4c82-b79b-5c099bf25a16', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 16:15:01.859463 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8e15af89-658b-4832-a051-ef061357fb70 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:01.860061 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8e15af89-658b-4832-a051-ef061357fb70 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:01.860562 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8e15af89-658b-4832-a051-ef061357fb70 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:01.861359 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8e15af89-658b-4832-a051-ef061357fb70 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:01.861925 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8e15af89-658b-4832-a051-ef061357fb70 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:01.862417 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8e15af89-658b-4832-a051-ef061357fb70 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:02.243155 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8e15af89-658b-4832-a051-ef061357fb70 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:02.252026 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8e15af89-658b-4832-a051-ef061357fb70 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.406253 Sep 04 16:15:02.252830 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 92/173] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:01 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:15:02.425717 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fd36c686-0b17-4161-adaf-5e0a5ce5e2c1 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:02.427283 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fd36c686-0b17-4161-adaf-5e0a5ce5e2c1 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:02.448335 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fd36c686-0b17-4161-adaf-5e0a5ce5e2c1 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:02.448990 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fd36c686-0b17-4161-adaf-5e0a5ce5e2c1 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:02.449914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fd36c686-0b17-4161-adaf-5e0a5ce5e2c1 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:02.450886 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fd36c686-0b17-4161-adaf-5e0a5ce5e2c1 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:02.451479 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fd36c686-0b17-4161-adaf-5e0a5ce5e2c1 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:02.452094 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fd36c686-0b17-4161-adaf-5e0a5ce5e2c1 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:02.812189 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fd36c686-0b17-4161-adaf-5e0a5ce5e2c1 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:02.821080 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fd36c686-0b17-4161-adaf-5e0a5ce5e2c1 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1512 microversion: 2.1 time: 0.400878 Sep 04 16:15:02.821794 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 93/174] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:02 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1512 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:15:02.838748 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-e1c12158-0e0c-4838-ab16-af394c799dfd req-e0913080-c4cb-4fbd-bd72-f13d24f12a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b95d4253-8af1-41cb-94f9-59b563be0d1d", "name": "network-vif-deleted", "tag": "432267bf-359a-4cef-aa7e-120c224fc8fe"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:15:02.850755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-e1c12158-0e0c-4838-ab16-af394c799dfd req-e0913080-c4cb-4fbd-bd72-f13d24f12a65 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:02.851339 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-e1c12158-0e0c-4838-ab16-af394c799dfd req-e0913080-c4cb-4fbd-bd72-f13d24f12a65 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:02.851875 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-e1c12158-0e0c-4838-ab16-af394c799dfd req-e0913080-c4cb-4fbd-bd72-f13d24f12a65 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:02.863073 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b4915a54-016f-4cd1-bf9c-4fae4a88e156 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 16:15:02.863543 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b4915a54-016f-4cd1-bf9c-4fae4a88e156 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 16:15:02.863989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b4915a54-016f-4cd1-bf9c-4fae4a88e156 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 16:15:02.864397 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b4915a54-016f-4cd1-bf9c-4fae4a88e156 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 16:15:02.864866 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-b4915a54-016f-4cd1-bf9c-4fae4a88e156 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 16:15:02.865515 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-e1c12158-0e0c-4838-ab16-af394c799dfd req-e0913080-c4cb-4fbd-bd72-f13d24f12a65 service nova] Creating event network-vif-deleted:432267bf-359a-4cef-aa7e-120c224fc8fe for instance b95d4253-8af1-41cb-94f9-59b563be0d1d on hv-cinder-85236 Sep 04 16:15:02.870613 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-e1c12158-0e0c-4838-ab16-af394c799dfd req-e0913080-c4cb-4fbd-bd72-f13d24f12a65 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040220 Sep 04 16:15:02.871258 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 94/175] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:15:02.874405 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4915a54-016f-4cd1-bf9c-4fae4a88e156 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:02.875270 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4915a54-016f-4cd1-bf9c-4fae4a88e156 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:02.875662 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4915a54-016f-4cd1-bf9c-4fae4a88e156 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:02.876394 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4915a54-016f-4cd1-bf9c-4fae4a88e156 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:02.876846 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4915a54-016f-4cd1-bf9c-4fae4a88e156 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:02.877442 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4915a54-016f-4cd1-bf9c-4fae4a88e156 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:02.895497 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-b4915a54-016f-4cd1-bf9c-4fae4a88e156 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Getting quotas for project 9f1ae25e634d4380a6933101fb94ad2e. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:15:02.899681 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-b4915a54-016f-4cd1-bf9c-4fae4a88e156 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Getting quotas for user a8925da59209424fbd6375f056aee752 and project 9f1ae25e634d4380a6933101fb94ad2e. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:15:02.912170 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b4915a54-016f-4cd1-bf9c-4fae4a88e156 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 16:15:02.914517 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b4915a54-016f-4cd1-bf9c-4fae4a88e156 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a460f6-29b0-46e6-ae98-e53ee2e13520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 16:15:03.060683 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b4915a54-016f-4cd1-bf9c-4fae4a88e156 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.288199 Sep 04 16:15:03.061338 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 82/176] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Sep 4 16:15:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 16:15:03.073850 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7706ac43-1ceb-44df-9b1c-e8e021fd2d97 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:03.074558 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7706ac43-1ceb-44df-9b1c-e8e021fd2d97 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:03.144022 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7706ac43-1ceb-44df-9b1c-e8e021fd2d97 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:03.152198 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7706ac43-1ceb-44df-9b1c-e8e021fd2d97 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5" status: 200 len: 1219 microversion: 2.1 time: 0.082389 Sep 04 16:15:03.152842 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 95/177] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:03 2022] GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:03.275520 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5b2ecbe6-b27d-459d-8bb6-bfb2036b5656 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:03.276185 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5b2ecbe6-b27d-459d-8bb6-bfb2036b5656 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:03.287562 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b2ecbe6-b27d-459d-8bb6-bfb2036b5656 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:03.288209 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b2ecbe6-b27d-459d-8bb6-bfb2036b5656 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:03.288760 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b2ecbe6-b27d-459d-8bb6-bfb2036b5656 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:03.289632 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b2ecbe6-b27d-459d-8bb6-bfb2036b5656 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:03.290255 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b2ecbe6-b27d-459d-8bb6-bfb2036b5656 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:03.290769 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b2ecbe6-b27d-459d-8bb6-bfb2036b5656 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:03.436672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5b2ecbe6-b27d-459d-8bb6-bfb2036b5656 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:03.444976 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5b2ecbe6-b27d-459d-8bb6-bfb2036b5656 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.173604 Sep 04 16:15:03.445583 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 83/178] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:03 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:03.848690 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5d644167-1215-48ae-89d3-7d2a98673d40 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:03.849307 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5d644167-1215-48ae-89d3-7d2a98673d40 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:03.868278 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5d644167-1215-48ae-89d3-7d2a98673d40 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:03.873047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5d644167-1215-48ae-89d3-7d2a98673d40 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:03.873047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5d644167-1215-48ae-89d3-7d2a98673d40 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:03.873047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5d644167-1215-48ae-89d3-7d2a98673d40 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:03.873047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5d644167-1215-48ae-89d3-7d2a98673d40 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:03.873354 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5d644167-1215-48ae-89d3-7d2a98673d40 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:03.909399 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5d644167-1215-48ae-89d3-7d2a98673d40 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:03.909904 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5d644167-1215-48ae-89d3-7d2a98673d40 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:03.910332 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5d644167-1215-48ae-89d3-7d2a98673d40 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:03.910769 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-5d644167-1215-48ae-89d3-7d2a98673d40 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lazy-loading 'fault' on Instance uuid b95d4253-8af1-41cb-94f9-59b563be0d1d {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:15:03.916558 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:15:03.958159 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5d644167-1215-48ae-89d3-7d2a98673d40 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1af03ad31a34f319763a6b5451ae26e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17338e3b6b204595a43fddc1c00ed26b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:03.967100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5d644167-1215-48ae-89d3-7d2a98673d40 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 200 len: 1351 microversion: 2.1 time: 0.125217 Sep 04 16:15:03.974285 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 96/179] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:03 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 1351 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:04.176024 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1f2a46ba-d91b-4e1f-a36c-66d4e232ef85 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:04.176758 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1f2a46ba-d91b-4e1f-a36c-66d4e232ef85 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:04.231697 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1f2a46ba-d91b-4e1f-a36c-66d4e232ef85 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:04.238816 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1f2a46ba-d91b-4e1f-a36c-66d4e232ef85 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5" status: 200 len: 1219 microversion: 2.1 time: 0.066527 Sep 04 16:15:04.239552 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 84/180] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:04 2022] GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:04.472840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d248a538-8586-407d-8872-767190faae0d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:04.477535 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d248a538-8586-407d-8872-767190faae0d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:04.479744 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d248a538-8586-407d-8872-767190faae0d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:04.480223 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d248a538-8586-407d-8872-767190faae0d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:04.480669 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d248a538-8586-407d-8872-767190faae0d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:04.481344 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d248a538-8586-407d-8872-767190faae0d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:04.481826 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d248a538-8586-407d-8872-767190faae0d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:04.482246 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d248a538-8586-407d-8872-767190faae0d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:04.631103 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d248a538-8586-407d-8872-767190faae0d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:04.641579 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d248a538-8586-407d-8872-767190faae0d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.173118 Sep 04 16:15:04.642114 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 97/181] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:04 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:04.991138 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d44205a6-353c-443e-90d6-32a5a062beba tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:04.991820 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d44205a6-353c-443e-90d6-32a5a062beba tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:04.998372 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d44205a6-353c-443e-90d6-32a5a062beba tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:04.999068 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d44205a6-353c-443e-90d6-32a5a062beba tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:04.999541 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d44205a6-353c-443e-90d6-32a5a062beba tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:05.000232 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d44205a6-353c-443e-90d6-32a5a062beba tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:05.000687 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d44205a6-353c-443e-90d6-32a5a062beba tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:05.001106 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d44205a6-353c-443e-90d6-32a5a062beba tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:05.015398 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-d44205a6-353c-443e-90d6-32a5a062beba tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] HTTP exception thrown: Instance b95d4253-8af1-41cb-94f9-59b563be0d1d could not be found. Sep 04 16:15:05.024507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d44205a6-353c-443e-90d6-32a5a062beba tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Request method failure captured: Sep 04 16:15:05.024507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d HTTP/1.1 Sep 04 16:15:05.024507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:15:05.024507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:15:05.024507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:15:05.024507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 04 16:15:05.024507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:15:05.024507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:15:05.024507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:15:05.024507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:15:05.024507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFM67u9PT7zyduH3EyA1WblNxRFXJEy0-bV-p41SC2agrtGwHX7JBXcIHG9dNOLY1oslx3TcW7-3XCVg6GQ9c85-LMzJS3IWKC9qG_OtnNcymKVYZmAAokXimb3rzeS9IFrg-XOmabNAyM5-Afvk2ju8y6uvR8AAc9BQuz2f8lYbMYk0 Sep 04 16:15:05.024507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:15:05.024507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:15:05.024507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:15:05.024507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:15:05.024507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:15:05.024507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:15:05.024507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: 17338e3b6b204595a43fddc1c00ed26b Sep 04 16:15:05.024507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-DeleteServersTestJSON-859926494 Sep 04 16:15:05.024507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:15:05.024507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:15:05.025752 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/17338e3b6b204595a43fddc1c00ed26b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/17338e3b6b204595a43fddc1c00ed26b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_17338e3b6b204595a43fddc1c00ed26b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/17338e3b6b204595a43fddc1c00ed26b"}]}] Sep 04 16:15:05.025752 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-DeleteServersTestJSON-859926494 Sep 04 16:15:05.025752 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: 17338e3b6b204595a43fddc1c00ed26b Sep 04 16:15:05.025752 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-DeleteServersTestJSON-859926494 Sep 04 16:15:05.025752 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-DeleteServersTestJSON-859926494-project Sep 04 16:15:05.025752 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:15:05.025752 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:15:05.025752 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: f1af03ad31a34f319763a6b5451ae26e Sep 04 16:15:05.025752 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-DeleteServersTestJSON-859926494-project Sep 04 16:15:05.025752 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: > Sep 04 16:15:05.025752 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Instance b95d4253-8af1-41cb-94f9-59b563be0d1d could not be found. Sep 04 16:15:05.025752 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'id': 'b95d4253-8af1-41cb-94f9-59b563be0d1d'} Sep 04 16:15:05.026466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:15:05.026466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:15:05.026466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:15:05.026466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:15:05.026466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:15:05.026466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:15:05.026466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:15:05.026466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:15:05.026466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:15:05.026466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:15:05.026466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b95d4253-8af1-41cb-94f9-59b563be0d1d could not be found. Sep 04 16:15:05.026466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:15:05.026466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:15:05.026466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:15:05.026466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:15:05.026466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:15:05.026466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:15:05.026466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:15:05.026466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:15:05.026466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:15:05.027760 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:15:05.027760 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:15:05.027760 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:15:05.027760 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:15:05.027760 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:15:05.027760 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:15:05.027760 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:15:05.027760 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b95d4253-8af1-41cb-94f9-59b563be0d1d could not be found. Sep 04 16:15:05.027760 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:15:05.027760 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:15:05.027760 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:15:05.027760 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:15:05.027760 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:15:05.027760 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:15:05.027760 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:15:05.027760 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:15:05.027760 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b95d4253-8af1-41cb-94f9-59b563be0d1d could not be found. Sep 04 16:15:05.027760 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:15:05.028701 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d44205a6-353c-443e-90d6-32a5a062beba tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Returning 404 to user: Instance b95d4253-8af1-41cb-94f9-59b563be0d1d could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:15:05.028701 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d44205a6-353c-443e-90d6-32a5a062beba tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 404 len: 111 microversion: 2.1 time: 0.038724 Sep 04 16:15:05.034788 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 85/182] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:04 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:15:05.161693 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a8a46ed7-4eba-4f72-a5c7-203370d13506 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:05.165759 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a8a46ed7-4eba-4f72-a5c7-203370d13506 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:05.173454 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a8a46ed7-4eba-4f72-a5c7-203370d13506 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:05.174033 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a8a46ed7-4eba-4f72-a5c7-203370d13506 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:05.174693 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a8a46ed7-4eba-4f72-a5c7-203370d13506 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:05.175487 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a8a46ed7-4eba-4f72-a5c7-203370d13506 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:05.176574 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a8a46ed7-4eba-4f72-a5c7-203370d13506 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:05.177016 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a8a46ed7-4eba-4f72-a5c7-203370d13506 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:05.194890 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-a8a46ed7-4eba-4f72-a5c7-203370d13506 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] HTTP exception thrown: Instance b95d4253-8af1-41cb-94f9-59b563be0d1d could not be found. Sep 04 16:15:05.200244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a8a46ed7-4eba-4f72-a5c7-203370d13506 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Request method failure captured: Sep 04 16:15:05.200244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d/os-volume_attachments HTTP/1.1 Sep 04 16:15:05.200244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:15:05.200244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:15:05.200244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:15:05.200244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:15:05.200244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:15:05.200244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:15:05.200244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:15:05.200244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:15:05.200244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFM67u9PT7zyduH3EyA1WblNxRFXJEy0-bV-p41SC2agrtGwHX7JBXcIHG9dNOLY1oslx3TcW7-3XCVg6GQ9c85-LMzJS3IWKC9qG_OtnNcymKVYZmAAokXimb3rzeS9IFrg-XOmabNAyM5-Afvk2ju8y6uvR8AAc9BQuz2f8lYbMYk0 Sep 04 16:15:05.200244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:15:05.200244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:15:05.200244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:15:05.200244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:15:05.200244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:15:05.200244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:15:05.200244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: 17338e3b6b204595a43fddc1c00ed26b Sep 04 16:15:05.200244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-DeleteServersTestJSON-859926494 Sep 04 16:15:05.200244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:15:05.200244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:15:05.201337 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/17338e3b6b204595a43fddc1c00ed26b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/17338e3b6b204595a43fddc1c00ed26b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_17338e3b6b204595a43fddc1c00ed26b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/17338e3b6b204595a43fddc1c00ed26b"}]}] Sep 04 16:15:05.201337 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-DeleteServersTestJSON-859926494 Sep 04 16:15:05.201337 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 17338e3b6b204595a43fddc1c00ed26b Sep 04 16:15:05.201337 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-DeleteServersTestJSON-859926494 Sep 04 16:15:05.201337 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-DeleteServersTestJSON-859926494-project Sep 04 16:15:05.201337 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:15:05.201337 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:15:05.201337 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: f1af03ad31a34f319763a6b5451ae26e Sep 04 16:15:05.201337 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-DeleteServersTestJSON-859926494-project Sep 04 16:15:05.201337 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: > Sep 04 16:15:05.201337 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Instance b95d4253-8af1-41cb-94f9-59b563be0d1d could not be found. Sep 04 16:15:05.201337 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'server_id': 'b95d4253-8af1-41cb-94f9-59b563be0d1d'} Sep 04 16:15:05.202152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:15:05.202152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:15:05.202152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:15:05.202152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:15:05.202152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:15:05.202152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:15:05.202152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:15:05.202152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:15:05.202152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:15:05.202152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:15:05.202152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b95d4253-8af1-41cb-94f9-59b563be0d1d could not be found. Sep 04 16:15:05.202152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:15:05.202152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:15:05.202152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:15:05.202152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:15:05.202152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:15:05.202152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:15:05.202152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:15:05.202152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:15:05.202152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:15:05.203571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:15:05.203571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 04 16:15:05.203571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 04 16:15:05.203571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 04 16:15:05.203571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 04 16:15:05.203571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 04 16:15:05.203571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 04 16:15:05.203571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:15:05.203571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:15:05.203571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b95d4253-8af1-41cb-94f9-59b563be0d1d could not be found. Sep 04 16:15:05.203571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:15:05.203571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:15:05.203571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:15:05.203571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:15:05.203571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:15:05.203571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:15:05.203571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:15:05.203571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:15:05.203571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b95d4253-8af1-41cb-94f9-59b563be0d1d could not be found. Sep 04 16:15:05.203571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:15:05.204712 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a8a46ed7-4eba-4f72-a5c7-203370d13506 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Returning 404 to user: Instance b95d4253-8af1-41cb-94f9-59b563be0d1d could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:15:05.204712 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a8a46ed7-4eba-4f72-a5c7-203370d13506 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044832 Sep 04 16:15:05.204712 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 98/183] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:15:05 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:15:05.272283 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7128b9d9-cdbb-4075-bb18-d132f19ba145 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:05.272897 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7128b9d9-cdbb-4075-bb18-d132f19ba145 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:05.285452 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7128b9d9-cdbb-4075-bb18-d132f19ba145 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:05.286135 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7128b9d9-cdbb-4075-bb18-d132f19ba145 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:05.291364 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7128b9d9-cdbb-4075-bb18-d132f19ba145 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:05.291364 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7128b9d9-cdbb-4075-bb18-d132f19ba145 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:05.291364 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7128b9d9-cdbb-4075-bb18-d132f19ba145 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:05.291364 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7128b9d9-cdbb-4075-bb18-d132f19ba145 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:05.360102 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7128b9d9-cdbb-4075-bb18-d132f19ba145 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:05.367925 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7128b9d9-cdbb-4075-bb18-d132f19ba145 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5" status: 200 len: 1271 microversion: 2.1 time: 0.099553 Sep 04 16:15:05.368588 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 86/184] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:05 2022] GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5 => generated 1271 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:05.666204 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f1c5dc63-5d23-486e-be76-0ca78efe9b93 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:05.666830 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f1c5dc63-5d23-486e-be76-0ca78efe9b93 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:05.674312 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1c5dc63-5d23-486e-be76-0ca78efe9b93 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:05.674798 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1c5dc63-5d23-486e-be76-0ca78efe9b93 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:05.675232 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1c5dc63-5d23-486e-be76-0ca78efe9b93 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:05.678664 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1c5dc63-5d23-486e-be76-0ca78efe9b93 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:05.678664 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1c5dc63-5d23-486e-be76-0ca78efe9b93 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:05.678664 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1c5dc63-5d23-486e-be76-0ca78efe9b93 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:05.826551 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f1c5dc63-5d23-486e-be76-0ca78efe9b93 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:05.835293 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f1c5dc63-5d23-486e-be76-0ca78efe9b93 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.173133 Sep 04 16:15:05.835859 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 99/185] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:05 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:06.392849 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8f94a073-4493-4bb7-b66b-156718805487 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:06.393379 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8f94a073-4493-4bb7-b66b-156718805487 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:06.400177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f94a073-4493-4bb7-b66b-156718805487 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:06.400737 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f94a073-4493-4bb7-b66b-156718805487 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:06.401233 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f94a073-4493-4bb7-b66b-156718805487 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:06.402150 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f94a073-4493-4bb7-b66b-156718805487 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:06.402792 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f94a073-4493-4bb7-b66b-156718805487 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:06.403427 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8f94a073-4493-4bb7-b66b-156718805487 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:06.489127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-8f94a073-4493-4bb7-b66b-156718805487 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:06.493079 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8f94a073-4493-4bb7-b66b-156718805487 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5" status: 200 len: 1277 microversion: 2.1 time: 0.105357 Sep 04 16:15:06.493834 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 87/186] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:06 2022] GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5 => generated 1277 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:06.664146 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a1ced131-b3b9-4f35-bb01-f0778ccf687a tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:06.664636 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a1ced131-b3b9-4f35-bb01-f0778ccf687a tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:06.670562 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1ced131-b3b9-4f35-bb01-f0778ccf687a tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:06.671140 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1ced131-b3b9-4f35-bb01-f0778ccf687a tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:06.671575 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1ced131-b3b9-4f35-bb01-f0778ccf687a tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:06.672471 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1ced131-b3b9-4f35-bb01-f0778ccf687a tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:06.673003 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1ced131-b3b9-4f35-bb01-f0778ccf687a tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:06.673419 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a1ced131-b3b9-4f35-bb01-f0778ccf687a tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:06.688429 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-a1ced131-b3b9-4f35-bb01-f0778ccf687a tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] HTTP exception thrown: Instance b95d4253-8af1-41cb-94f9-59b563be0d1d could not be found. Sep 04 16:15:06.690627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a1ced131-b3b9-4f35-bb01-f0778ccf687a tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Request method failure captured: Sep 04 16:15:06.690627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: DELETE /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d HTTP/1.1 Sep 04 16:15:06.690627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:15:06.690627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:15:06.690627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:15:06.690627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:15:06.690627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:15:06.690627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:15:06.690627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:15:06.690627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:15:06.690627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFM67u9PT7zyduH3EyA1WblNxRFXJEy0-bV-p41SC2agrtGwHX7JBXcIHG9dNOLY1oslx3TcW7-3XCVg6GQ9c85-LMzJS3IWKC9qG_OtnNcymKVYZmAAokXimb3rzeS9IFrg-XOmabNAyM5-Afvk2ju8y6uvR8AAc9BQuz2f8lYbMYk0 Sep 04 16:15:06.690627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:15:06.690627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:15:06.690627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:15:06.690627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:15:06.690627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:15:06.690627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:15:06.690627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: 17338e3b6b204595a43fddc1c00ed26b Sep 04 16:15:06.690627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-DeleteServersTestJSON-859926494 Sep 04 16:15:06.690627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:15:06.690627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:15:06.693195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/17338e3b6b204595a43fddc1c00ed26b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/17338e3b6b204595a43fddc1c00ed26b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_17338e3b6b204595a43fddc1c00ed26b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/17338e3b6b204595a43fddc1c00ed26b"}]}] Sep 04 16:15:06.693195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-DeleteServersTestJSON-859926494 Sep 04 16:15:06.693195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 17338e3b6b204595a43fddc1c00ed26b Sep 04 16:15:06.693195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-DeleteServersTestJSON-859926494 Sep 04 16:15:06.693195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-DeleteServersTestJSON-859926494-project Sep 04 16:15:06.693195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:15:06.693195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:15:06.693195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: f1af03ad31a34f319763a6b5451ae26e Sep 04 16:15:06.693195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-DeleteServersTestJSON-859926494-project Sep 04 16:15:06.693195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: > Sep 04 16:15:06.693195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Instance b95d4253-8af1-41cb-94f9-59b563be0d1d could not be found. Sep 04 16:15:06.693195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': 'b95d4253-8af1-41cb-94f9-59b563be0d1d'} Sep 04 16:15:06.694251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:15:06.694251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:15:06.694251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:15:06.694251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:15:06.694251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:15:06.694251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:15:06.694251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:15:06.694251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:15:06.694251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:15:06.694251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:15:06.694251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b95d4253-8af1-41cb-94f9-59b563be0d1d could not be found. Sep 04 16:15:06.694251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:15:06.694251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:15:06.694251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:15:06.694251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:15:06.694251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:15:06.694251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:15:06.694251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:15:06.694251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:15:06.694251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:15:06.695653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:15:06.695653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 04 16:15:06.695653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 04 16:15:06.695653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 04 16:15:06.695653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 04 16:15:06.695653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:15:06.695653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:15:06.695653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:15:06.695653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:15:06.695653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b95d4253-8af1-41cb-94f9-59b563be0d1d could not be found. Sep 04 16:15:06.695653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:15:06.695653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:15:06.695653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:15:06.695653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:15:06.695653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:15:06.695653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:15:06.695653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:15:06.695653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:15:06.695653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b95d4253-8af1-41cb-94f9-59b563be0d1d could not be found. Sep 04 16:15:06.695653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:15:06.697056 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a1ced131-b3b9-4f35-bb01-f0778ccf687a tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Returning 404 to user: Instance b95d4253-8af1-41cb-94f9-59b563be0d1d could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:15:06.697056 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a1ced131-b3b9-4f35-bb01-f0778ccf687a tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 404 len: 111 microversion: 2.1 time: 0.031650 Sep 04 16:15:06.697056 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 100/187] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:15:06 2022] DELETE /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:15:06.700390 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-52c827d7-7f6c-4cdb-91a7-449d7c721547 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:06.700981 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-52c827d7-7f6c-4cdb-91a7-449d7c721547 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] [instance: b95d4253-8af1-41cb-94f9-59b563be0d1d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:06.707462 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52c827d7-7f6c-4cdb-91a7-449d7c721547 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:06.708285 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52c827d7-7f6c-4cdb-91a7-449d7c721547 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:06.708577 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52c827d7-7f6c-4cdb-91a7-449d7c721547 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:06.709267 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52c827d7-7f6c-4cdb-91a7-449d7c721547 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:06.709755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52c827d7-7f6c-4cdb-91a7-449d7c721547 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:06.710170 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52c827d7-7f6c-4cdb-91a7-449d7c721547 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:06.724139 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-52c827d7-7f6c-4cdb-91a7-449d7c721547 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] HTTP exception thrown: Instance b95d4253-8af1-41cb-94f9-59b563be0d1d could not be found. Sep 04 16:15:06.736845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-52c827d7-7f6c-4cdb-91a7-449d7c721547 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Request method failure captured: Sep 04 16:15:06.736845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d HTTP/1.1 Sep 04 16:15:06.736845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:15:06.736845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:15:06.736845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:15:06.736845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 04 16:15:06.736845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:15:06.736845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:15:06.736845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:15:06.736845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:15:06.736845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFM67u9PT7zyduH3EyA1WblNxRFXJEy0-bV-p41SC2agrtGwHX7JBXcIHG9dNOLY1oslx3TcW7-3XCVg6GQ9c85-LMzJS3IWKC9qG_OtnNcymKVYZmAAokXimb3rzeS9IFrg-XOmabNAyM5-Afvk2ju8y6uvR8AAc9BQuz2f8lYbMYk0 Sep 04 16:15:06.736845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:15:06.736845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:15:06.736845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:15:06.736845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:15:06.736845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:15:06.736845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:15:06.736845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: 17338e3b6b204595a43fddc1c00ed26b Sep 04 16:15:06.736845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-DeleteServersTestJSON-859926494 Sep 04 16:15:06.736845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:15:06.736845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:15:06.738127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/17338e3b6b204595a43fddc1c00ed26b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/17338e3b6b204595a43fddc1c00ed26b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_17338e3b6b204595a43fddc1c00ed26b", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/17338e3b6b204595a43fddc1c00ed26b"}]}] Sep 04 16:15:06.738127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-DeleteServersTestJSON-859926494 Sep 04 16:15:06.738127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: 17338e3b6b204595a43fddc1c00ed26b Sep 04 16:15:06.738127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-DeleteServersTestJSON-859926494 Sep 04 16:15:06.738127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-DeleteServersTestJSON-859926494-project Sep 04 16:15:06.738127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:15:06.738127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:15:06.738127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: f1af03ad31a34f319763a6b5451ae26e Sep 04 16:15:06.738127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-DeleteServersTestJSON-859926494-project Sep 04 16:15:06.738127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: > Sep 04 16:15:06.738127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Instance b95d4253-8af1-41cb-94f9-59b563be0d1d could not be found. Sep 04 16:15:06.738127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'id': 'b95d4253-8af1-41cb-94f9-59b563be0d1d'} Sep 04 16:15:06.738764 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:15:06.738764 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:15:06.738764 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:15:06.738764 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:15:06.738764 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:15:06.738764 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:15:06.738764 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:15:06.738764 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:15:06.738764 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:15:06.738764 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:15:06.738764 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b95d4253-8af1-41cb-94f9-59b563be0d1d could not be found. Sep 04 16:15:06.738764 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:15:06.738764 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:15:06.738764 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:15:06.738764 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:15:06.738764 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:15:06.738764 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:15:06.738764 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:15:06.738764 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:15:06.738764 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:15:06.740542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:15:06.740542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:15:06.740542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:15:06.740542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:15:06.740542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:15:06.740542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:15:06.740542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:15:06.740542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b95d4253-8af1-41cb-94f9-59b563be0d1d could not be found. Sep 04 16:15:06.740542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:15:06.740542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:15:06.740542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:15:06.740542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:15:06.740542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:15:06.740542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:15:06.740542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:15:06.740542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:15:06.740542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b95d4253-8af1-41cb-94f9-59b563be0d1d could not be found. Sep 04 16:15:06.740542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:15:06.741695 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-52c827d7-7f6c-4cdb-91a7-449d7c721547 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] Returning 404 to user: Instance b95d4253-8af1-41cb-94f9-59b563be0d1d could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:15:06.741695 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-52c827d7-7f6c-4cdb-91a7-449d7c721547 tempest-DeleteServersTestJSON-859926494 tempest-DeleteServersTestJSON-859926494-project] 10.222.0.39 "GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d" status: 404 len: 111 microversion: 2.1 time: 0.030506 Sep 04 16:15:06.741695 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 88/188] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:06 2022] GET /compute/v2.1/servers/b95d4253-8af1-41cb-94f9-59b563be0d1d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:15:06.862551 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ed4fc226-d709-4074-91d3-b7af9490924b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:06.863172 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ed4fc226-d709-4074-91d3-b7af9490924b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:06.875820 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ed4fc226-d709-4074-91d3-b7af9490924b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:06.876303 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ed4fc226-d709-4074-91d3-b7af9490924b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:06.876872 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ed4fc226-d709-4074-91d3-b7af9490924b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:06.877800 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ed4fc226-d709-4074-91d3-b7af9490924b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:06.878415 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ed4fc226-d709-4074-91d3-b7af9490924b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:06.878983 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ed4fc226-d709-4074-91d3-b7af9490924b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:07.090015 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ed4fc226-d709-4074-91d3-b7af9490924b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:07.099061 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ed4fc226-d709-4074-91d3-b7af9490924b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.243998 Sep 04 16:15:07.100004 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 101/189] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:06 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:07.523294 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8e30c578-1c1b-4fd6-9ac3-839ee74df138 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:07.523945 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8e30c578-1c1b-4fd6-9ac3-839ee74df138 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:07.547860 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e30c578-1c1b-4fd6-9ac3-839ee74df138 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:07.550206 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e30c578-1c1b-4fd6-9ac3-839ee74df138 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:07.551827 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e30c578-1c1b-4fd6-9ac3-839ee74df138 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:07.553167 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e30c578-1c1b-4fd6-9ac3-839ee74df138 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:07.558749 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e30c578-1c1b-4fd6-9ac3-839ee74df138 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:07.559291 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e30c578-1c1b-4fd6-9ac3-839ee74df138 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:07.895027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-8e30c578-1c1b-4fd6-9ac3-839ee74df138 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:07.924533 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8e30c578-1c1b-4fd6-9ac3-839ee74df138 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5" status: 200 len: 1319 microversion: 2.1 time: 0.405553 Sep 04 16:15:07.925214 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 89/190] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:07 2022] GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5 => generated 1319 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:08.077907 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-62b83da8-bbb3-466f-a99d-9b0c234f51ce req-bc72d9b9-faa4-4269-8ddc-a3b286d10dbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dea006b1-47f7-4cc7-aeb1-04ab2266daa5", "tag": "c990bd22-f4cb-4576-b878-e869548ceeb2"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:15:08.090115 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-62b83da8-bbb3-466f-a99d-9b0c234f51ce req-bc72d9b9-faa4-4269-8ddc-a3b286d10dbe service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:08.090737 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-62b83da8-bbb3-466f-a99d-9b0c234f51ce req-bc72d9b9-faa4-4269-8ddc-a3b286d10dbe service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:08.091285 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-62b83da8-bbb3-466f-a99d-9b0c234f51ce req-bc72d9b9-faa4-4269-8ddc-a3b286d10dbe service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:08.105711 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-62b83da8-bbb3-466f-a99d-9b0c234f51ce req-bc72d9b9-faa4-4269-8ddc-a3b286d10dbe service nova] Creating event network-changed:c990bd22-f4cb-4576-b878-e869548ceeb2 for instance dea006b1-47f7-4cc7-aeb1-04ab2266daa5 on hv-cinder-85236 Sep 04 16:15:08.113368 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-62b83da8-bbb3-466f-a99d-9b0c234f51ce req-bc72d9b9-faa4-4269-8ddc-a3b286d10dbe service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041197 Sep 04 16:15:08.114276 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 102/191] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:15:08.140935 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eb01c2bf-3064-42a9-9409-65c9a518fc27 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:08.140935 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eb01c2bf-3064-42a9-9409-65c9a518fc27 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:08.157529 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb01c2bf-3064-42a9-9409-65c9a518fc27 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:08.158183 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb01c2bf-3064-42a9-9409-65c9a518fc27 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:08.158914 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb01c2bf-3064-42a9-9409-65c9a518fc27 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:08.168972 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb01c2bf-3064-42a9-9409-65c9a518fc27 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:08.169472 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb01c2bf-3064-42a9-9409-65c9a518fc27 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:08.170114 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eb01c2bf-3064-42a9-9409-65c9a518fc27 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:08.404017 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-eb01c2bf-3064-42a9-9409-65c9a518fc27 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:08.414381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eb01c2bf-3064-42a9-9409-65c9a518fc27 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.282819 Sep 04 16:15:08.415495 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 90/192] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:08 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:08.955677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0e96dec1-1af5-4f64-99ba-f22b96c5f167 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:08.956391 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0e96dec1-1af5-4f64-99ba-f22b96c5f167 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:08.963464 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0e96dec1-1af5-4f64-99ba-f22b96c5f167 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:08.964035 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0e96dec1-1af5-4f64-99ba-f22b96c5f167 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:08.964554 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0e96dec1-1af5-4f64-99ba-f22b96c5f167 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:08.965608 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0e96dec1-1af5-4f64-99ba-f22b96c5f167 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:08.966130 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0e96dec1-1af5-4f64-99ba-f22b96c5f167 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:08.966616 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0e96dec1-1af5-4f64-99ba-f22b96c5f167 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:09.201145 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0e96dec1-1af5-4f64-99ba-f22b96c5f167 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:09.210785 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0e96dec1-1af5-4f64-99ba-f22b96c5f167 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5" status: 200 len: 1319 microversion: 2.1 time: 0.260159 Sep 04 16:15:09.211279 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 103/193] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:08 2022] GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5 => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:09.441094 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e2e7d619-9d04-4d90-a8c5-691b8a26bc30 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:09.441741 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e2e7d619-9d04-4d90-a8c5-691b8a26bc30 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:09.449668 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2e7d619-9d04-4d90-a8c5-691b8a26bc30 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:09.450149 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2e7d619-9d04-4d90-a8c5-691b8a26bc30 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:09.450589 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2e7d619-9d04-4d90-a8c5-691b8a26bc30 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:09.451333 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2e7d619-9d04-4d90-a8c5-691b8a26bc30 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:09.451781 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2e7d619-9d04-4d90-a8c5-691b8a26bc30 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:09.452441 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e2e7d619-9d04-4d90-a8c5-691b8a26bc30 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:09.658012 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e2e7d619-9d04-4d90-a8c5-691b8a26bc30 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:09.665818 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e2e7d619-9d04-4d90-a8c5-691b8a26bc30 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.231504 Sep 04 16:15:09.666826 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 91/194] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:09 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:10.233722 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e036786a-9159-4a72-86f5-50423922be08 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:10.234335 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e036786a-9159-4a72-86f5-50423922be08 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:10.241235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e036786a-9159-4a72-86f5-50423922be08 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:10.241700 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e036786a-9159-4a72-86f5-50423922be08 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:10.242147 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e036786a-9159-4a72-86f5-50423922be08 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:10.242825 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e036786a-9159-4a72-86f5-50423922be08 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:10.243328 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e036786a-9159-4a72-86f5-50423922be08 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:10.243753 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e036786a-9159-4a72-86f5-50423922be08 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:10.430502 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e036786a-9159-4a72-86f5-50423922be08 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:10.439253 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e036786a-9159-4a72-86f5-50423922be08 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5" status: 200 len: 1319 microversion: 2.1 time: 0.209433 Sep 04 16:15:10.440296 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 104/195] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:10 2022] GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:10.690020 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7125f4f3-5814-4bef-9d6d-259cc8ee6324 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:10.690640 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7125f4f3-5814-4bef-9d6d-259cc8ee6324 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:10.698110 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7125f4f3-5814-4bef-9d6d-259cc8ee6324 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:10.698599 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7125f4f3-5814-4bef-9d6d-259cc8ee6324 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:10.699031 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7125f4f3-5814-4bef-9d6d-259cc8ee6324 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:10.699730 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7125f4f3-5814-4bef-9d6d-259cc8ee6324 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:10.700568 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7125f4f3-5814-4bef-9d6d-259cc8ee6324 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:10.700968 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7125f4f3-5814-4bef-9d6d-259cc8ee6324 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:10.881502 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7125f4f3-5814-4bef-9d6d-259cc8ee6324 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:10.889548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7125f4f3-5814-4bef-9d6d-259cc8ee6324 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.203751 Sep 04 16:15:10.890683 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 92/196] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:10 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:11.465277 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7e45d062-ff31-4c88-b904-6f486b362286 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:11.466804 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7e45d062-ff31-4c88-b904-6f486b362286 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:11.484242 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e45d062-ff31-4c88-b904-6f486b362286 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:11.484242 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e45d062-ff31-4c88-b904-6f486b362286 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:11.484242 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e45d062-ff31-4c88-b904-6f486b362286 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:11.484242 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e45d062-ff31-4c88-b904-6f486b362286 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:11.484989 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e45d062-ff31-4c88-b904-6f486b362286 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:11.484989 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7e45d062-ff31-4c88-b904-6f486b362286 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:11.682575 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7e45d062-ff31-4c88-b904-6f486b362286 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:11.691388 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7e45d062-ff31-4c88-b904-6f486b362286 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5" status: 200 len: 1319 microversion: 2.1 time: 0.232044 Sep 04 16:15:11.704876 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 105/197] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:11 2022] GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:11.916537 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c2afc1ec-4d98-40f4-8413-ed76f219fba9 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:11.917014 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c2afc1ec-4d98-40f4-8413-ed76f219fba9 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:11.926425 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2afc1ec-4d98-40f4-8413-ed76f219fba9 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:11.926912 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2afc1ec-4d98-40f4-8413-ed76f219fba9 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:11.927366 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2afc1ec-4d98-40f4-8413-ed76f219fba9 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:11.928059 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2afc1ec-4d98-40f4-8413-ed76f219fba9 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:11.928510 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2afc1ec-4d98-40f4-8413-ed76f219fba9 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:11.928931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2afc1ec-4d98-40f4-8413-ed76f219fba9 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:12.056509 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c2afc1ec-4d98-40f4-8413-ed76f219fba9 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:12.065892 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c2afc1ec-4d98-40f4-8413-ed76f219fba9 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.155861 Sep 04 16:15:12.066607 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 93/198] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:11 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:12.713797 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-80b0e7bc-fedd-43bb-bd6a-fa671d22660e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:12.714406 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-80b0e7bc-fedd-43bb-bd6a-fa671d22660e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:12.721412 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-80b0e7bc-fedd-43bb-bd6a-fa671d22660e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:12.721913 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-80b0e7bc-fedd-43bb-bd6a-fa671d22660e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:12.722351 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-80b0e7bc-fedd-43bb-bd6a-fa671d22660e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:12.723039 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-80b0e7bc-fedd-43bb-bd6a-fa671d22660e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:12.723488 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-80b0e7bc-fedd-43bb-bd6a-fa671d22660e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:12.723908 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-80b0e7bc-fedd-43bb-bd6a-fa671d22660e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:12.863302 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-80b0e7bc-fedd-43bb-bd6a-fa671d22660e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:12.878973 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-80b0e7bc-fedd-43bb-bd6a-fa671d22660e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5" status: 200 len: 1319 microversion: 2.1 time: 0.167681 Sep 04 16:15:12.878973 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 106/199] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:12 2022] GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:13.095607 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aff6a00b-df3d-42de-9515-50238f41e4be tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:13.096845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aff6a00b-df3d-42de-9515-50238f41e4be tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:13.100662 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:15:13.112513 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aff6a00b-df3d-42de-9515-50238f41e4be tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:13.113001 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aff6a00b-df3d-42de-9515-50238f41e4be tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:13.113682 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aff6a00b-df3d-42de-9515-50238f41e4be tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:13.114386 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aff6a00b-df3d-42de-9515-50238f41e4be tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:13.115514 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aff6a00b-df3d-42de-9515-50238f41e4be tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:13.116232 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aff6a00b-df3d-42de-9515-50238f41e4be tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:13.259514 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-aff6a00b-df3d-42de-9515-50238f41e4be tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:13.268478 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aff6a00b-df3d-42de-9515-50238f41e4be tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.178088 Sep 04 16:15:13.269201 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 94/200] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:13 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:13.900154 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-925e9942-f150-4ab6-85be-f1dff13dc4b7 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:13.900751 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-925e9942-f150-4ab6-85be-f1dff13dc4b7 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:13.902744 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:15:13.903428 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=75 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:15:13.908165 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-925e9942-f150-4ab6-85be-f1dff13dc4b7 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:13.908639 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-925e9942-f150-4ab6-85be-f1dff13dc4b7 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:13.909094 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-925e9942-f150-4ab6-85be-f1dff13dc4b7 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:13.909804 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-925e9942-f150-4ab6-85be-f1dff13dc4b7 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:13.910254 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-925e9942-f150-4ab6-85be-f1dff13dc4b7 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:13.910736 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-925e9942-f150-4ab6-85be-f1dff13dc4b7 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:14.289547 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-925e9942-f150-4ab6-85be-f1dff13dc4b7 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:14.292967 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5ee3a22c-4d2b-4fae-b9f7-87365c4e9bc5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:14.293697 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5ee3a22c-4d2b-4fae-b9f7-87365c4e9bc5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:14.296654 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=8 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:15:14.298761 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-925e9942-f150-4ab6-85be-f1dff13dc4b7 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5" status: 200 len: 1319 microversion: 2.1 time: 0.401747 Sep 04 16:15:14.299513 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 107/201] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:13 2022] GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5 => generated 1319 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:14.304793 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ee3a22c-4d2b-4fae-b9f7-87365c4e9bc5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:14.305769 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ee3a22c-4d2b-4fae-b9f7-87365c4e9bc5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:14.306069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ee3a22c-4d2b-4fae-b9f7-87365c4e9bc5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:14.306753 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ee3a22c-4d2b-4fae-b9f7-87365c4e9bc5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:14.307209 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ee3a22c-4d2b-4fae-b9f7-87365c4e9bc5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:14.307790 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5ee3a22c-4d2b-4fae-b9f7-87365c4e9bc5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:14.464083 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5ee3a22c-4d2b-4fae-b9f7-87365c4e9bc5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:14.473137 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5ee3a22c-4d2b-4fae-b9f7-87365c4e9bc5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.185218 Sep 04 16:15:14.473739 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 95/202] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:14 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:15.101914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b9ef1d23-a6be-4f4c-851e-592aa0c2e2b1 tempest-VolumesTestJSON-495116568 tempest-VolumesTestJSON-495116568-project] Calling method '.version_select at 0x7f968936f940>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:15.150584 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b9ef1d23-a6be-4f4c-851e-592aa0c2e2b1 tempest-VolumesTestJSON-495116568 tempest-VolumesTestJSON-495116568-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/7e1da0a5-cfef-445e-be94-173f7d9aaf34" status: 200 len: 350 microversion: 2.1 time: 0.052645 Sep 04 16:15:15.151217 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 108/203] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Sep 4 16:15:15 2022] GET /compute/v2.1/os-volumes/7e1da0a5-cfef-445e-be94-173f7d9aaf34 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:15:15.329065 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cf005214-ca91-4a91-951d-240670efc8d0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:15.329786 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cf005214-ca91-4a91-951d-240670efc8d0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:15.339840 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf005214-ca91-4a91-951d-240670efc8d0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:15.340423 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf005214-ca91-4a91-951d-240670efc8d0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:15.341033 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf005214-ca91-4a91-951d-240670efc8d0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:15.341814 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf005214-ca91-4a91-951d-240670efc8d0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:15.342362 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf005214-ca91-4a91-951d-240670efc8d0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:15.343394 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf005214-ca91-4a91-951d-240670efc8d0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:15.497554 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-15255951-2bf1-405d-8aa0-4fb69fd3f5ef tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:15.499984 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-cf005214-ca91-4a91-951d-240670efc8d0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:15.500127 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-15255951-2bf1-405d-8aa0-4fb69fd3f5ef tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:15.507246 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-15255951-2bf1-405d-8aa0-4fb69fd3f5ef tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:15.507991 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-15255951-2bf1-405d-8aa0-4fb69fd3f5ef tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:15.508612 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-15255951-2bf1-405d-8aa0-4fb69fd3f5ef tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:15.509467 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-15255951-2bf1-405d-8aa0-4fb69fd3f5ef tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:15.510208 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cf005214-ca91-4a91-951d-240670efc8d0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5" status: 200 len: 1319 microversion: 2.1 time: 0.186232 Sep 04 16:15:15.510350 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-15255951-2bf1-405d-8aa0-4fb69fd3f5ef tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:15.510761 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 96/204] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:15 2022] GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:15:15.518968 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-15255951-2bf1-405d-8aa0-4fb69fd3f5ef tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:15.672235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-15255951-2bf1-405d-8aa0-4fb69fd3f5ef tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:15.680745 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-15255951-2bf1-405d-8aa0-4fb69fd3f5ef tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.188002 Sep 04 16:15:15.694185 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 109/205] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:15 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:15:15.731916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-2f7d4781-b355-415f-ad85-7bae7484720e req-c2a6854b-e9b9-4e9c-8741-6549ae7cd882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea006b1-47f7-4cc7-aeb1-04ab2266daa5", "name": "network-vif-plugged", "status": "completed", "tag": "c990bd22-f4cb-4576-b878-e869548ceeb2"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:15:15.742128 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2f7d4781-b355-415f-ad85-7bae7484720e req-c2a6854b-e9b9-4e9c-8741-6549ae7cd882 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:15.742673 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2f7d4781-b355-415f-ad85-7bae7484720e req-c2a6854b-e9b9-4e9c-8741-6549ae7cd882 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:15.743169 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2f7d4781-b355-415f-ad85-7bae7484720e req-c2a6854b-e9b9-4e9c-8741-6549ae7cd882 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:15.755264 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-2f7d4781-b355-415f-ad85-7bae7484720e req-c2a6854b-e9b9-4e9c-8741-6549ae7cd882 service nova] Creating event network-vif-plugged:c990bd22-f4cb-4576-b878-e869548ceeb2 for instance dea006b1-47f7-4cc7-aeb1-04ab2266daa5 on hv-cinder-85236 Sep 04 16:15:15.760306 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-2f7d4781-b355-415f-ad85-7bae7484720e req-c2a6854b-e9b9-4e9c-8741-6549ae7cd882 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032397 Sep 04 16:15:15.760904 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 97/206] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:15:16.611889 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5cc8dd28-a8ca-4b17-a3db-580ce12b56ed tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:16.611889 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5cc8dd28-a8ca-4b17-a3db-580ce12b56ed tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:16.611889 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5cc8dd28-a8ca-4b17-a3db-580ce12b56ed tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:16.611889 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5cc8dd28-a8ca-4b17-a3db-580ce12b56ed tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:16.614006 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5cc8dd28-a8ca-4b17-a3db-580ce12b56ed tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:16.614006 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5cc8dd28-a8ca-4b17-a3db-580ce12b56ed tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:16.614006 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5cc8dd28-a8ca-4b17-a3db-580ce12b56ed tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:16.614006 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5cc8dd28-a8ca-4b17-a3db-580ce12b56ed tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:16.690080 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5cc8dd28-a8ca-4b17-a3db-580ce12b56ed tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:16.698721 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5cc8dd28-a8ca-4b17-a3db-580ce12b56ed tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5" status: 200 len: 1319 microversion: 2.1 time: 0.168576 Sep 04 16:15:16.706213 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-88c6ec29-d52d-456d-940c-027c4f48a551 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:16.707781 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-88c6ec29-d52d-456d-940c-027c4f48a551 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:16.712397 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 110/207] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:16 2022] GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:16.730182 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88c6ec29-d52d-456d-940c-027c4f48a551 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:16.730685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88c6ec29-d52d-456d-940c-027c4f48a551 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:16.731389 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88c6ec29-d52d-456d-940c-027c4f48a551 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:16.732270 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88c6ec29-d52d-456d-940c-027c4f48a551 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:16.732890 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88c6ec29-d52d-456d-940c-027c4f48a551 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:16.733347 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88c6ec29-d52d-456d-940c-027c4f48a551 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:16.870070 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-88c6ec29-d52d-456d-940c-027c4f48a551 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:16.879575 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-88c6ec29-d52d-456d-940c-027c4f48a551 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.178920 Sep 04 16:15:16.890251 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 98/208] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:16 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:15:16.935121 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-71a7757d-b900-4e4f-ae23-df3208d0f863 tempest-VolumesTestJSON-495116568 tempest-VolumesTestJSON-495116568-project] Calling method '.version_select at 0x7f9689369f70>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:16.984705 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-71a7757d-b900-4e4f-ae23-df3208d0f863 tempest-VolumesTestJSON-495116568 tempest-VolumesTestJSON-495116568-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/cb41dc2b-6fd9-4589-8663-4de04a2d5825" status: 200 len: 351 microversion: 2.1 time: 0.053308 Sep 04 16:15:16.985444 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 111/209] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Sep 4 16:15:16 2022] GET /compute/v2.1/os-volumes/cb41dc2b-6fd9-4589-8663-4de04a2d5825 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:15:17.736904 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a480bb53-de25-4349-922f-3e72f163448f tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:17.737507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a480bb53-de25-4349-922f-3e72f163448f tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:17.745481 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a480bb53-de25-4349-922f-3e72f163448f tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:17.746224 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a480bb53-de25-4349-922f-3e72f163448f tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:17.746652 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a480bb53-de25-4349-922f-3e72f163448f tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:17.747384 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a480bb53-de25-4349-922f-3e72f163448f tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:17.747883 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a480bb53-de25-4349-922f-3e72f163448f tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:17.748468 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a480bb53-de25-4349-922f-3e72f163448f tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:17.878641 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a480bb53-de25-4349-922f-3e72f163448f tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:17.886164 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a480bb53-de25-4349-922f-3e72f163448f tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5" status: 200 len: 1319 microversion: 2.1 time: 0.153725 Sep 04 16:15:17.886717 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 99/210] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:17 2022] GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:17.906208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ceeb5904-b772-4961-9a75-9b7cd90a6997 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:17.907169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ceeb5904-b772-4961-9a75-9b7cd90a6997 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:17.913878 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ceeb5904-b772-4961-9a75-9b7cd90a6997 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:17.914370 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ceeb5904-b772-4961-9a75-9b7cd90a6997 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:17.914830 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ceeb5904-b772-4961-9a75-9b7cd90a6997 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:17.915528 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ceeb5904-b772-4961-9a75-9b7cd90a6997 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:17.915978 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ceeb5904-b772-4961-9a75-9b7cd90a6997 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:17.916397 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ceeb5904-b772-4961-9a75-9b7cd90a6997 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:18.052734 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ceeb5904-b772-4961-9a75-9b7cd90a6997 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:18.060650 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ceeb5904-b772-4961-9a75-9b7cd90a6997 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.159527 Sep 04 16:15:18.061911 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 112/211] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:17 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:15:18.909143 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-20f16f04-97df-40c0-909e-f1dda08b0da0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:18.909785 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-20f16f04-97df-40c0-909e-f1dda08b0da0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:18.913443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:15:18.916993 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20f16f04-97df-40c0-909e-f1dda08b0da0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:18.917678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20f16f04-97df-40c0-909e-f1dda08b0da0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:18.918317 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20f16f04-97df-40c0-909e-f1dda08b0da0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:18.919120 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20f16f04-97df-40c0-909e-f1dda08b0da0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:18.919569 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20f16f04-97df-40c0-909e-f1dda08b0da0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:18.920121 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20f16f04-97df-40c0-909e-f1dda08b0da0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:18.925470 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:15:19.060308 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-20f16f04-97df-40c0-909e-f1dda08b0da0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:19.068744 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-20f16f04-97df-40c0-909e-f1dda08b0da0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5" status: 200 len: 1319 microversion: 2.1 time: 0.164505 Sep 04 16:15:19.069612 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 100/212] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:18 2022] GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:19.088042 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e49ca4a5-1083-4d10-9c88-be3ae3c98c63 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:19.088685 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e49ca4a5-1083-4d10-9c88-be3ae3c98c63 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:19.095603 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e49ca4a5-1083-4d10-9c88-be3ae3c98c63 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:19.096092 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e49ca4a5-1083-4d10-9c88-be3ae3c98c63 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:19.096523 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e49ca4a5-1083-4d10-9c88-be3ae3c98c63 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:19.097216 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e49ca4a5-1083-4d10-9c88-be3ae3c98c63 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:19.097723 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e49ca4a5-1083-4d10-9c88-be3ae3c98c63 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:19.098144 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e49ca4a5-1083-4d10-9c88-be3ae3c98c63 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:19.254714 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e49ca4a5-1083-4d10-9c88-be3ae3c98c63 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:19.262700 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e49ca4a5-1083-4d10-9c88-be3ae3c98c63 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.178205 Sep 04 16:15:19.263534 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 113/213] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:19 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:20.092040 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-303da317-d393-4f60-9f81-97127d58a79e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:20.093198 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-303da317-d393-4f60-9f81-97127d58a79e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:20.103390 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-303da317-d393-4f60-9f81-97127d58a79e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:20.103898 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-303da317-d393-4f60-9f81-97127d58a79e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:20.104343 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-303da317-d393-4f60-9f81-97127d58a79e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:20.105080 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-303da317-d393-4f60-9f81-97127d58a79e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:20.105537 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-303da317-d393-4f60-9f81-97127d58a79e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:20.106004 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-303da317-d393-4f60-9f81-97127d58a79e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:20.236229 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-303da317-d393-4f60-9f81-97127d58a79e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:20.243846 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-303da317-d393-4f60-9f81-97127d58a79e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5" status: 200 len: 1319 microversion: 2.1 time: 0.156286 Sep 04 16:15:20.244402 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 101/214] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:20 2022] GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:20.287241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-52914295-cc2a-42be-8f8c-baa5e23a0597 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:20.287927 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-52914295-cc2a-42be-8f8c-baa5e23a0597 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:20.293980 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-52914295-cc2a-42be-8f8c-baa5e23a0597 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:20.294534 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-52914295-cc2a-42be-8f8c-baa5e23a0597 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:20.295074 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-52914295-cc2a-42be-8f8c-baa5e23a0597 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:20.295832 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-52914295-cc2a-42be-8f8c-baa5e23a0597 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:20.297365 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-52914295-cc2a-42be-8f8c-baa5e23a0597 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:20.297707 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-52914295-cc2a-42be-8f8c-baa5e23a0597 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:20.442534 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-52914295-cc2a-42be-8f8c-baa5e23a0597 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:20.454473 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-52914295-cc2a-42be-8f8c-baa5e23a0597 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.171232 Sep 04 16:15:20.455055 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 114/215] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:20 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:20.830314 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f4e95c37-d903-4e40-942a-23ac76438cd9 tempest-VolumesTestJSON-495116568 tempest-VolumesTestJSON-495116568-project] Calling method '.version_select at 0x7f96893629d0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:20.880245 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f4e95c37-d903-4e40-942a-23ac76438cd9 tempest-VolumesTestJSON-495116568 tempest-VolumesTestJSON-495116568-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/ffb409d5-2f01-403b-812f-6013bbc0263b" status: 200 len: 350 microversion: 2.1 time: 0.054036 Sep 04 16:15:20.880814 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 102/216] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Sep 4 16:15:20 2022] GET /compute/v2.1/os-volumes/ffb409d5-2f01-403b-812f-6013bbc0263b => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:15:20.894564 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-dab27e69-70c5-49d9-a536-4ba424e7b872 tempest-VolumesTestJSON-495116568 tempest-VolumesTestJSON-495116568-project] Calling method '.version_select at 0x7f96894dac10>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:20.988183 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-dab27e69-70c5-49d9-a536-4ba424e7b872 tempest-VolumesTestJSON-495116568 tempest-VolumesTestJSON-495116568-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.097278 Sep 04 16:15:20.998573 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 115/217] 10.222.0.39 () {58 vars in 1134 bytes} [Sun Sep 4 16:15:20 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:21.004813 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d0a13cd7-5eac-4a9b-b875-edeef5217ac1 tempest-VolumesTestJSON-495116568 tempest-VolumesTestJSON-495116568-project] Calling method '.version_select at 0x7f968937a790>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:21.097844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d0a13cd7-5eac-4a9b-b875-edeef5217ac1 tempest-VolumesTestJSON-495116568 tempest-VolumesTestJSON-495116568-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.096930 Sep 04 16:15:21.098630 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 103/218] 10.222.0.39 () {58 vars in 1149 bytes} [Sun Sep 4 16:15:20 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:15:21.113732 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d85c034b-571c-464d-a5e4-56938c089840 tempest-VolumesTestJSON-495116568 tempest-VolumesTestJSON-495116568-project] Calling method '.version_select at 0x7f9689369820>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:21.209245 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d85c034b-571c-464d-a5e4-56938c089840 tempest-VolumesTestJSON-495116568 tempest-VolumesTestJSON-495116568-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.099231 Sep 04 16:15:21.209948 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 116/219] 10.222.0.39 () {58 vars in 1134 bytes} [Sun Sep 4 16:15:21 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:21.224041 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-95904b83-b8ee-4892-8c40-87d0d01df013 tempest-VolumesTestJSON-495116568 tempest-VolumesTestJSON-495116568-project] Calling method '.version_select at 0x7f9689374e50>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:21.266662 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-28bcf682-2333-402b-97e0-e9d516c5017b tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:21.267431 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-28bcf682-2333-402b-97e0-e9d516c5017b tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:21.274405 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-28bcf682-2333-402b-97e0-e9d516c5017b tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:21.274965 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-28bcf682-2333-402b-97e0-e9d516c5017b tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:21.275462 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-28bcf682-2333-402b-97e0-e9d516c5017b tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:21.276218 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-28bcf682-2333-402b-97e0-e9d516c5017b tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:21.276737 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-28bcf682-2333-402b-97e0-e9d516c5017b tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:21.277223 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-28bcf682-2333-402b-97e0-e9d516c5017b tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:21.333385 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-95904b83-b8ee-4892-8c40-87d0d01df013 tempest-VolumesTestJSON-495116568 tempest-VolumesTestJSON-495116568-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.112493 Sep 04 16:15:21.341885 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 104/220] 10.222.0.39 () {58 vars in 1167 bytes} [Sun Sep 4 16:15:21 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:15:21.346658 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4caa628d-bea8-442e-8dc0-68f86159e539 tempest-VolumesTestJSON-495116568 tempest-VolumesTestJSON-495116568-project] Calling method '.version_select at 0x7f96893625e0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:21.432416 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-28bcf682-2333-402b-97e0-e9d516c5017b tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:21.438586 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-28bcf682-2333-402b-97e0-e9d516c5017b tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5" status: 200 len: 1509 microversion: 2.1 time: 0.176551 Sep 04 16:15:21.439473 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 117/221] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:21 2022] GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5 => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:15:21.447047 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4caa628d-bea8-442e-8dc0-68f86159e539 tempest-VolumesTestJSON-495116568 tempest-VolumesTestJSON-495116568-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.103972 Sep 04 16:15:21.447921 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 105/222] 10.222.0.39 () {58 vars in 1170 bytes} [Sun Sep 4 16:15:21 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:15:21.465507 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8fa6de01-c15d-43eb-b306-1f8ebb4324a4 tempest-VolumesTestJSON-495116568 tempest-VolumesTestJSON-495116568-project] Calling method '.version_select at 0x7f96895f63a0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:21.479162 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2b602d36-969f-4e7d-9738-a3c417c95f17 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:21.480285 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2b602d36-969f-4e7d-9738-a3c417c95f17 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:21.495654 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b602d36-969f-4e7d-9738-a3c417c95f17 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:21.495654 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b602d36-969f-4e7d-9738-a3c417c95f17 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:21.495654 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b602d36-969f-4e7d-9738-a3c417c95f17 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:21.495873 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b602d36-969f-4e7d-9738-a3c417c95f17 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:21.496384 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b602d36-969f-4e7d-9738-a3c417c95f17 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:21.496805 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2b602d36-969f-4e7d-9738-a3c417c95f17 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:21.560705 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8fa6de01-c15d-43eb-b306-1f8ebb4324a4 tempest-VolumesTestJSON-495116568 tempest-VolumesTestJSON-495116568-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.100875 Sep 04 16:15:21.561464 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 118/223] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Sep 4 16:15:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:21.574873 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-48359942-2f4b-4d7e-aa95-35889368194b tempest-VolumesTestJSON-495116568 tempest-VolumesTestJSON-495116568-project] Calling method '.version_select at 0x7f9689343f70>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:21.634315 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2b602d36-969f-4e7d-9738-a3c417c95f17 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:21.646448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2b602d36-969f-4e7d-9738-a3c417c95f17 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.171448 Sep 04 16:15:21.647586 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 106/224] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:21 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:15:21.719730 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-48359942-2f4b-4d7e-aa95-35889368194b tempest-VolumesTestJSON-495116568 tempest-VolumesTestJSON-495116568-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.148580 Sep 04 16:15:21.720374 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 119/225] 10.222.0.39 () {58 vars in 1188 bytes} [Sun Sep 4 16:15:21 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:15:21.736700 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-89ad612f-370c-42e2-8068-5e33d666d28a tempest-VolumesTestJSON-495116568 tempest-VolumesTestJSON-495116568-project] Calling method '.version_select at 0x7f9689487af0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:21.949797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-89ad612f-370c-42e2-8068-5e33d666d28a tempest-VolumesTestJSON-495116568 tempest-VolumesTestJSON-495116568-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.219081 Sep 04 16:15:21.950366 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 107/226] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Sep 4 16:15:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:22.671477 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5959fe90-fa5d-4e4a-921b-e0974a1511d3 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:22.672212 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5959fe90-fa5d-4e4a-921b-e0974a1511d3 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:22.678894 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5959fe90-fa5d-4e4a-921b-e0974a1511d3 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:22.679365 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5959fe90-fa5d-4e4a-921b-e0974a1511d3 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:22.679790 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5959fe90-fa5d-4e4a-921b-e0974a1511d3 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:22.680459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5959fe90-fa5d-4e4a-921b-e0974a1511d3 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:22.680904 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5959fe90-fa5d-4e4a-921b-e0974a1511d3 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:22.681504 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5959fe90-fa5d-4e4a-921b-e0974a1511d3 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:22.855847 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5959fe90-fa5d-4e4a-921b-e0974a1511d3 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:22.856488 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5959fe90-fa5d-4e4a-921b-e0974a1511d3 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.189292 Sep 04 16:15:22.857240 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 120/227] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:22 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:23.885187 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8e4d14b8-4fff-4d6e-b48c-ed1324d856aa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:23.885187 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8e4d14b8-4fff-4d6e-b48c-ed1324d856aa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:23.890400 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e4d14b8-4fff-4d6e-b48c-ed1324d856aa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:23.890984 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e4d14b8-4fff-4d6e-b48c-ed1324d856aa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:23.891473 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e4d14b8-4fff-4d6e-b48c-ed1324d856aa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:23.892320 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e4d14b8-4fff-4d6e-b48c-ed1324d856aa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:23.892774 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e4d14b8-4fff-4d6e-b48c-ed1324d856aa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:23.893197 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e4d14b8-4fff-4d6e-b48c-ed1324d856aa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:24.069844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-8e4d14b8-4fff-4d6e-b48c-ed1324d856aa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:24.078796 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8e4d14b8-4fff-4d6e-b48c-ed1324d856aa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.202008 Sep 04 16:15:24.079380 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 108/228] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:23 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:25.102314 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a0f0a22f-7c48-428d-8bf6-3527292aec39 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:25.103096 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a0f0a22f-7c48-428d-8bf6-3527292aec39 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:25.109180 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0f0a22f-7c48-428d-8bf6-3527292aec39 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:25.109712 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0f0a22f-7c48-428d-8bf6-3527292aec39 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:25.110150 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0f0a22f-7c48-428d-8bf6-3527292aec39 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:25.110835 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0f0a22f-7c48-428d-8bf6-3527292aec39 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:25.111294 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0f0a22f-7c48-428d-8bf6-3527292aec39 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:25.111743 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0f0a22f-7c48-428d-8bf6-3527292aec39 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:25.115685 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:15:25.242951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a0f0a22f-7c48-428d-8bf6-3527292aec39 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:25.251352 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a0f0a22f-7c48-428d-8bf6-3527292aec39 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.152831 Sep 04 16:15:25.252197 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 121/229] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:25 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:26.276496 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-50b1f019-585c-4193-9cfa-2f5c831bbf22 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:26.277109 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-50b1f019-585c-4193-9cfa-2f5c831bbf22 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:26.284421 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50b1f019-585c-4193-9cfa-2f5c831bbf22 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:26.284971 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50b1f019-585c-4193-9cfa-2f5c831bbf22 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:26.285407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50b1f019-585c-4193-9cfa-2f5c831bbf22 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:26.286137 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50b1f019-585c-4193-9cfa-2f5c831bbf22 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:26.287127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50b1f019-585c-4193-9cfa-2f5c831bbf22 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:26.287127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50b1f019-585c-4193-9cfa-2f5c831bbf22 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:26.427796 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-50b1f019-585c-4193-9cfa-2f5c831bbf22 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:26.436181 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-50b1f019-585c-4193-9cfa-2f5c831bbf22 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.163645 Sep 04 16:15:26.436803 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 109/230] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:26 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:27.462464 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0743242c-8fb4-4d81-b5b2-3e0bdc8cb492 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:27.463274 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0743242c-8fb4-4d81-b5b2-3e0bdc8cb492 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:27.473108 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0743242c-8fb4-4d81-b5b2-3e0bdc8cb492 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:27.473590 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0743242c-8fb4-4d81-b5b2-3e0bdc8cb492 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:27.478929 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0743242c-8fb4-4d81-b5b2-3e0bdc8cb492 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:27.478929 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0743242c-8fb4-4d81-b5b2-3e0bdc8cb492 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:27.478929 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0743242c-8fb4-4d81-b5b2-3e0bdc8cb492 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:27.478929 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0743242c-8fb4-4d81-b5b2-3e0bdc8cb492 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:27.647644 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0743242c-8fb4-4d81-b5b2-3e0bdc8cb492 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:27.656537 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0743242c-8fb4-4d81-b5b2-3e0bdc8cb492 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.200073 Sep 04 16:15:27.670384 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 122/231] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:27 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:28.680306 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c3a82076-e61f-41b3-b3e6-1b4e3a2f8cd2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:28.680914 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c3a82076-e61f-41b3-b3e6-1b4e3a2f8cd2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:28.688099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c3a82076-e61f-41b3-b3e6-1b4e3a2f8cd2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:28.688825 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c3a82076-e61f-41b3-b3e6-1b4e3a2f8cd2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:28.689477 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c3a82076-e61f-41b3-b3e6-1b4e3a2f8cd2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:28.690207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c3a82076-e61f-41b3-b3e6-1b4e3a2f8cd2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:28.690659 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c3a82076-e61f-41b3-b3e6-1b4e3a2f8cd2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:28.691081 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c3a82076-e61f-41b3-b3e6-1b4e3a2f8cd2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:29.041007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c3a82076-e61f-41b3-b3e6-1b4e3a2f8cd2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:29.050132 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c3a82076-e61f-41b3-b3e6-1b4e3a2f8cd2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1520 microversion: 2.1 time: 0.373537 Sep 04 16:15:29.050934 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 110/232] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:28 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1520 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:30.074700 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-54924752-ca39-4483-bb6d-4e8886926e78 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:30.076343 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-54924752-ca39-4483-bb6d-4e8886926e78 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:30.089279 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54924752-ca39-4483-bb6d-4e8886926e78 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:30.090079 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54924752-ca39-4483-bb6d-4e8886926e78 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:30.090527 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54924752-ca39-4483-bb6d-4e8886926e78 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:30.091448 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54924752-ca39-4483-bb6d-4e8886926e78 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:30.091901 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54924752-ca39-4483-bb6d-4e8886926e78 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:30.092633 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54924752-ca39-4483-bb6d-4e8886926e78 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:30.362813 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-54924752-ca39-4483-bb6d-4e8886926e78 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:30.372002 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-54924752-ca39-4483-bb6d-4e8886926e78 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1500 microversion: 2.1 time: 0.301733 Sep 04 16:15:30.372592 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 123/233] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:30 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1500 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:30.399334 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1d9dc067-2ee2-4bab-8a2f-c66af751ef2b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:30.404526 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1d9dc067-2ee2-4bab-8a2f-c66af751ef2b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:30.416195 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d9dc067-2ee2-4bab-8a2f-c66af751ef2b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:30.417061 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d9dc067-2ee2-4bab-8a2f-c66af751ef2b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:30.417595 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d9dc067-2ee2-4bab-8a2f-c66af751ef2b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:30.418397 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d9dc067-2ee2-4bab-8a2f-c66af751ef2b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:30.419039 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d9dc067-2ee2-4bab-8a2f-c66af751ef2b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:30.419536 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d9dc067-2ee2-4bab-8a2f-c66af751ef2b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:30.578829 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1d9dc067-2ee2-4bab-8a2f-c66af751ef2b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:30.587509 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1d9dc067-2ee2-4bab-8a2f-c66af751ef2b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1515 microversion: 2.1 time: 0.194029 Sep 04 16:15:30.588076 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 111/234] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:30 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1515 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:32.741465 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-772417ca-ebef-41be-8467-01d22e4814b0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:15:32.744043 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-772417ca-ebef-41be-8467-01d22e4814b0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:32.753994 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-772417ca-ebef-41be-8467-01d22e4814b0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:32.754748 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-772417ca-ebef-41be-8467-01d22e4814b0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:32.755344 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-772417ca-ebef-41be-8467-01d22e4814b0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:32.759819 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-772417ca-ebef-41be-8467-01d22e4814b0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:32.759819 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-772417ca-ebef-41be-8467-01d22e4814b0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:32.759819 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-772417ca-ebef-41be-8467-01d22e4814b0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:32.786052 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-772417ca-ebef-41be-8467-01d22e4814b0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lazy-loading 'flavor' on Instance uuid ee1afbcb-161b-4255-af5d-7aa20d2bf66f {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:15:33.109492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-772417ca-ebef-41be-8467-01d22e4814b0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "POST /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f/action" status: 200 len: 32 microversion: 2.1 time: 0.372638 Sep 04 16:15:33.115711 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 124/235] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Sep 4 16:15:32 2022] POST /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f/action => generated 32 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 04 16:15:33.122294 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-84b49798-8471-4cfa-9377-b78ecad910aa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:33.123487 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-84b49798-8471-4cfa-9377-b78ecad910aa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:33.148283 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84b49798-8471-4cfa-9377-b78ecad910aa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:33.160325 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84b49798-8471-4cfa-9377-b78ecad910aa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:33.165236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84b49798-8471-4cfa-9377-b78ecad910aa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:33.169339 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84b49798-8471-4cfa-9377-b78ecad910aa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:33.169675 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84b49798-8471-4cfa-9377-b78ecad910aa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:33.173518 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84b49798-8471-4cfa-9377-b78ecad910aa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:33.647539 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-84b49798-8471-4cfa-9377-b78ecad910aa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:33.655958 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-84b49798-8471-4cfa-9377-b78ecad910aa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1521 microversion: 2.1 time: 0.537874 Sep 04 16:15:33.661804 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 112/236] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:33 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1521 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:15:34.358330 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-246450b3-76fb-457a-b3a8-a84b0d518021 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-566522522", "imageRef": "11a460f6-29b0-46e6-ae98-e53ee2e13520", "flavorRef": "452"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:15:34.491481 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-246450b3-76fb-457a-b3a8-a84b0d518021 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] validate_networks() for None {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 16:15:34.681709 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e7e9bdce-61e8-4864-bba3-d4042588279b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:34.682964 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e7e9bdce-61e8-4864-bba3-d4042588279b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:34.692266 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7e9bdce-61e8-4864-bba3-d4042588279b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:34.695245 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7e9bdce-61e8-4864-bba3-d4042588279b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:34.695245 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7e9bdce-61e8-4864-bba3-d4042588279b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:34.695245 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7e9bdce-61e8-4864-bba3-d4042588279b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:34.695245 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7e9bdce-61e8-4864-bba3-d4042588279b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:34.695585 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7e9bdce-61e8-4864-bba3-d4042588279b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:35.193630 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e7e9bdce-61e8-4864-bba3-d4042588279b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:35.201910 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e7e9bdce-61e8-4864-bba3-d4042588279b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1521 microversion: 2.1 time: 0.525934 Sep 04 16:15:35.218579 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 113/237] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:34 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1521 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:15:35.283855 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-246450b3-76fb-457a-b3a8-a84b0d518021 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 16:15:35.284256 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-246450b3-76fb-457a-b3a8-a84b0d518021 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 16:15:35.284918 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-246450b3-76fb-457a-b3a8-a84b0d518021 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 16:15:35.301083 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-246450b3-76fb-457a-b3a8-a84b0d518021 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 16:15:35.301691 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-246450b3-76fb-457a-b3a8-a84b0d518021 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 16:15:35.319658 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-246450b3-76fb-457a-b3a8-a84b0d518021 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:35.320150 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-246450b3-76fb-457a-b3a8-a84b0d518021 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:35.321365 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-246450b3-76fb-457a-b3a8-a84b0d518021 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:35.322155 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-246450b3-76fb-457a-b3a8-a84b0d518021 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:35.322619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-246450b3-76fb-457a-b3a8-a84b0d518021 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:35.333281 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-246450b3-76fb-457a-b3a8-a84b0d518021 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:35.400431 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-246450b3-76fb-457a-b3a8-a84b0d518021 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Getting quotas for project f0323333989a4014a3be79e8349e1840. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:15:35.403618 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-246450b3-76fb-457a-b3a8-a84b0d518021 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Getting quotas for user c835608161474af8a96909d20bc9c94d and project f0323333989a4014a3be79e8349e1840. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:15:35.427902 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-246450b3-76fb-457a-b3a8-a84b0d518021 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 16:15:35.445013 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-246450b3-76fb-457a-b3a8-a84b0d518021 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a460f6-29b0-46e6-ae98-e53ee2e13520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 16:15:35.684787 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-246450b3-76fb-457a-b3a8-a84b0d518021 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.335961 Sep 04 16:15:35.685494 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 125/238] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Sep 4 16:15:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 16:15:35.699359 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2bb70985-15f7-4538-b781-69c0ca1f7947 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:35.700737 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2bb70985-15f7-4538-b781-69c0ca1f7947 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:35.808355 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2bb70985-15f7-4538-b781-69c0ca1f7947 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:35.818165 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2bb70985-15f7-4538-b781-69c0ca1f7947 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1214 microversion: 2.1 time: 0.124142 Sep 04 16:15:35.821787 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 114/239] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:35 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1214 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:36.225188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-34acca08-85f4-4bc6-ae8c-4e026dfba8d8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:36.226049 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-34acca08-85f4-4bc6-ae8c-4e026dfba8d8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:36.234021 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-34acca08-85f4-4bc6-ae8c-4e026dfba8d8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:36.240972 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-34acca08-85f4-4bc6-ae8c-4e026dfba8d8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:36.241704 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-34acca08-85f4-4bc6-ae8c-4e026dfba8d8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:36.244147 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-34acca08-85f4-4bc6-ae8c-4e026dfba8d8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:36.244147 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-34acca08-85f4-4bc6-ae8c-4e026dfba8d8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:36.244147 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-34acca08-85f4-4bc6-ae8c-4e026dfba8d8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:36.554191 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-34acca08-85f4-4bc6-ae8c-4e026dfba8d8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:36.563381 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-34acca08-85f4-4bc6-ae8c-4e026dfba8d8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1521 microversion: 2.1 time: 0.341637 Sep 04 16:15:36.564201 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 126/240] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:36 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:15:36.848548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-56e3a7f5-9fd9-4a17-abe7-d894ac7a7772 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:36.849227 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-56e3a7f5-9fd9-4a17-abe7-d894ac7a7772 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:36.959757 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-56e3a7f5-9fd9-4a17-abe7-d894ac7a7772 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:36.968122 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-56e3a7f5-9fd9-4a17-abe7-d894ac7a7772 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1214 microversion: 2.1 time: 0.128820 Sep 04 16:15:36.980334 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 115/241] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:36 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1214 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:37.588347 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b5e5b80c-130b-46a7-a8a9-dd20056be93b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:37.590014 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b5e5b80c-130b-46a7-a8a9-dd20056be93b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:37.613903 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b5e5b80c-130b-46a7-a8a9-dd20056be93b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:37.616581 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b5e5b80c-130b-46a7-a8a9-dd20056be93b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:37.618492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b5e5b80c-130b-46a7-a8a9-dd20056be93b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:37.620277 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b5e5b80c-130b-46a7-a8a9-dd20056be93b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:37.620277 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b5e5b80c-130b-46a7-a8a9-dd20056be93b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:37.623034 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b5e5b80c-130b-46a7-a8a9-dd20056be93b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:37.973910 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b5e5b80c-130b-46a7-a8a9-dd20056be93b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:38.006032 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b0b81773-0cb7-486d-b32a-da65df9a4559 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:38.012878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b0b81773-0cb7-486d-b32a-da65df9a4559 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:38.026512 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b5e5b80c-130b-46a7-a8a9-dd20056be93b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1521 microversion: 2.1 time: 0.443159 Sep 04 16:15:38.033066 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0b81773-0cb7-486d-b32a-da65df9a4559 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:38.034212 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 127/242] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:37 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1521 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:38.034868 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0b81773-0cb7-486d-b32a-da65df9a4559 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:38.035739 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0b81773-0cb7-486d-b32a-da65df9a4559 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:38.036710 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0b81773-0cb7-486d-b32a-da65df9a4559 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:38.037394 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0b81773-0cb7-486d-b32a-da65df9a4559 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:38.038063 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b0b81773-0cb7-486d-b32a-da65df9a4559 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:38.144090 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b0b81773-0cb7-486d-b32a-da65df9a4559 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:38.156413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b0b81773-0cb7-486d-b32a-da65df9a4559 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1266 microversion: 2.1 time: 0.155663 Sep 04 16:15:38.169637 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 116/243] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:37 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:39.057227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ec9a418e-8c9b-4c45-a209-32e3dfc77a53 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:39.062625 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ec9a418e-8c9b-4c45-a209-32e3dfc77a53 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:39.066265 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec9a418e-8c9b-4c45-a209-32e3dfc77a53 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:39.067425 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec9a418e-8c9b-4c45-a209-32e3dfc77a53 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:39.068792 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec9a418e-8c9b-4c45-a209-32e3dfc77a53 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:39.072641 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec9a418e-8c9b-4c45-a209-32e3dfc77a53 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:39.073143 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec9a418e-8c9b-4c45-a209-32e3dfc77a53 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:39.074549 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec9a418e-8c9b-4c45-a209-32e3dfc77a53 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:39.189725 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-be4234ef-e05b-439f-a203-64fe6b63abf9 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:39.192482 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-be4234ef-e05b-439f-a203-64fe6b63abf9 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:39.199342 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be4234ef-e05b-439f-a203-64fe6b63abf9 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:39.200217 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be4234ef-e05b-439f-a203-64fe6b63abf9 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:39.201125 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be4234ef-e05b-439f-a203-64fe6b63abf9 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:39.202033 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be4234ef-e05b-439f-a203-64fe6b63abf9 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:39.202660 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be4234ef-e05b-439f-a203-64fe6b63abf9 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:39.203250 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be4234ef-e05b-439f-a203-64fe6b63abf9 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:39.342070 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-be4234ef-e05b-439f-a203-64fe6b63abf9 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:39.357110 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-be4234ef-e05b-439f-a203-64fe6b63abf9 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1266 microversion: 2.1 time: 0.173508 Sep 04 16:15:39.357521 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 117/244] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:39 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:15:39.394157 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ec9a418e-8c9b-4c45-a209-32e3dfc77a53 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:39.406643 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ec9a418e-8c9b-4c45-a209-32e3dfc77a53 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1521 microversion: 2.1 time: 0.350964 Sep 04 16:15:39.408775 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 128/245] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:39 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:40.381474 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-78a58718-62cb-44f2-84a9-a84c2a55c4ff tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:40.382701 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-78a58718-62cb-44f2-84a9-a84c2a55c4ff tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:40.390147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78a58718-62cb-44f2-84a9-a84c2a55c4ff tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:40.390630 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78a58718-62cb-44f2-84a9-a84c2a55c4ff tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:40.392149 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78a58718-62cb-44f2-84a9-a84c2a55c4ff tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:40.393067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78a58718-62cb-44f2-84a9-a84c2a55c4ff tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:40.393717 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78a58718-62cb-44f2-84a9-a84c2a55c4ff tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:40.394306 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78a58718-62cb-44f2-84a9-a84c2a55c4ff tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:40.432528 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-739ed11f-08a2-4a5f-9cd1-cd88f6ad98ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:40.433140 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-739ed11f-08a2-4a5f-9cd1-cd88f6ad98ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:40.448485 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-739ed11f-08a2-4a5f-9cd1-cd88f6ad98ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:40.448982 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-739ed11f-08a2-4a5f-9cd1-cd88f6ad98ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:40.449646 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-739ed11f-08a2-4a5f-9cd1-cd88f6ad98ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:40.450363 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-739ed11f-08a2-4a5f-9cd1-cd88f6ad98ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:40.450816 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-739ed11f-08a2-4a5f-9cd1-cd88f6ad98ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:40.451243 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-739ed11f-08a2-4a5f-9cd1-cd88f6ad98ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:40.507510 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-78a58718-62cb-44f2-84a9-a84c2a55c4ff tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:40.516878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-78a58718-62cb-44f2-84a9-a84c2a55c4ff tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1266 microversion: 2.1 time: 0.139573 Sep 04 16:15:40.534501 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 118/246] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:40 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:40.784900 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-739ed11f-08a2-4a5f-9cd1-cd88f6ad98ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:40.784900 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-739ed11f-08a2-4a5f-9cd1-cd88f6ad98ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1521 microversion: 2.1 time: 0.240905 Sep 04 16:15:40.784900 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 129/247] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:40 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:41.540393 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-adb82e8c-2513-431c-8c44-d98b99bc3577 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:41.540996 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-adb82e8c-2513-431c-8c44-d98b99bc3577 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:41.550276 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-adb82e8c-2513-431c-8c44-d98b99bc3577 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:41.553995 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-adb82e8c-2513-431c-8c44-d98b99bc3577 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:41.554656 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-adb82e8c-2513-431c-8c44-d98b99bc3577 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:41.557544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-adb82e8c-2513-431c-8c44-d98b99bc3577 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:41.559484 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-adb82e8c-2513-431c-8c44-d98b99bc3577 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:41.560229 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-adb82e8c-2513-431c-8c44-d98b99bc3577 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:41.675753 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-adb82e8c-2513-431c-8c44-d98b99bc3577 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:41.698360 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-defaab0d-87f8-47a8-a9f0-08bb3b99871f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:41.698968 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-defaab0d-87f8-47a8-a9f0-08bb3b99871f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:41.700842 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-adb82e8c-2513-431c-8c44-d98b99bc3577 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1266 microversion: 2.1 time: 0.158992 Sep 04 16:15:41.701686 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 119/248] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:41 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:41.710230 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-defaab0d-87f8-47a8-a9f0-08bb3b99871f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:41.713851 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-defaab0d-87f8-47a8-a9f0-08bb3b99871f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:41.713851 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-defaab0d-87f8-47a8-a9f0-08bb3b99871f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:41.713851 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-defaab0d-87f8-47a8-a9f0-08bb3b99871f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:41.713851 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-defaab0d-87f8-47a8-a9f0-08bb3b99871f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:41.714260 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-defaab0d-87f8-47a8-a9f0-08bb3b99871f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:42.010926 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-11889fab-aa53-4b81-9642-8bd1f84ea416 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:42.010926 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-11889fab-aa53-4b81-9642-8bd1f84ea416 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:42.026792 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11889fab-aa53-4b81-9642-8bd1f84ea416 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:42.029628 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11889fab-aa53-4b81-9642-8bd1f84ea416 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:42.030148 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11889fab-aa53-4b81-9642-8bd1f84ea416 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:42.031078 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11889fab-aa53-4b81-9642-8bd1f84ea416 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:42.032528 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11889fab-aa53-4b81-9642-8bd1f84ea416 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:42.033446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-11889fab-aa53-4b81-9642-8bd1f84ea416 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:42.119977 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-11889fab-aa53-4b81-9642-8bd1f84ea416 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/ips" status: 200 len: 151 microversion: 2.20 time: 0.127828 Sep 04 16:15:42.120960 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 120/249] 10.222.0.39 () {60 vars in 1289 bytes} [Sun Sep 4 16:15:41 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/ips => generated 151 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:15:42.128871 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-defaab0d-87f8-47a8-a9f0-08bb3b99871f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:42.164419 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-defaab0d-87f8-47a8-a9f0-08bb3b99871f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1521 microversion: 2.1 time: 0.467716 Sep 04 16:15:42.168318 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 130/250] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:41 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1521 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:42.731216 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c8d49b5a-28a0-4cd4-850f-be220436d129 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:42.734014 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c8d49b5a-28a0-4cd4-850f-be220436d129 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:42.751081 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8d49b5a-28a0-4cd4-850f-be220436d129 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:42.751081 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8d49b5a-28a0-4cd4-850f-be220436d129 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:42.751558 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8d49b5a-28a0-4cd4-850f-be220436d129 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:42.753440 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8d49b5a-28a0-4cd4-850f-be220436d129 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:42.753853 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8d49b5a-28a0-4cd4-850f-be220436d129 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:42.755228 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8d49b5a-28a0-4cd4-850f-be220436d129 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:42.975413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c8d49b5a-28a0-4cd4-850f-be220436d129 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:42.994806 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c8d49b5a-28a0-4cd4-850f-be220436d129 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1272 microversion: 2.1 time: 0.268481 Sep 04 16:15:43.017133 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 121/251] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:42 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1272 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:43.196080 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-96edd7e1-e19e-48b3-b911-cca11e5d3f5c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:43.196080 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-96edd7e1-e19e-48b3-b911-cca11e5d3f5c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:43.208497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-96edd7e1-e19e-48b3-b911-cca11e5d3f5c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:43.210026 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-96edd7e1-e19e-48b3-b911-cca11e5d3f5c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:43.211153 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-96edd7e1-e19e-48b3-b911-cca11e5d3f5c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:43.214257 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-96edd7e1-e19e-48b3-b911-cca11e5d3f5c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:43.215124 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-96edd7e1-e19e-48b3-b911-cca11e5d3f5c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:43.216476 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-96edd7e1-e19e-48b3-b911-cca11e5d3f5c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:43.925046 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-96edd7e1-e19e-48b3-b911-cca11e5d3f5c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:43.939261 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-96edd7e1-e19e-48b3-b911-cca11e5d3f5c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1521 microversion: 2.1 time: 0.747965 Sep 04 16:15:43.941319 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 131/252] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:43 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1521 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:44.024310 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-84c52614-d2c4-4b85-a632-b753a14e5ee3 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:44.026200 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-84c52614-d2c4-4b85-a632-b753a14e5ee3 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:44.039735 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84c52614-d2c4-4b85-a632-b753a14e5ee3 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:44.040241 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84c52614-d2c4-4b85-a632-b753a14e5ee3 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:44.040673 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84c52614-d2c4-4b85-a632-b753a14e5ee3 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:44.041377 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84c52614-d2c4-4b85-a632-b753a14e5ee3 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:44.041961 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84c52614-d2c4-4b85-a632-b753a14e5ee3 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:44.042417 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84c52614-d2c4-4b85-a632-b753a14e5ee3 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:44.296172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-84c52614-d2c4-4b85-a632-b753a14e5ee3 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:44.313959 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-84c52614-d2c4-4b85-a632-b753a14e5ee3 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1314 microversion: 2.1 time: 0.293833 Sep 04 16:15:44.319481 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 122/253] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:44 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:44.964584 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fff411d0-a245-406e-a34d-903e9bd16aaa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:44.965962 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fff411d0-a245-406e-a34d-903e9bd16aaa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:44.976891 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:15:44.979696 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fff411d0-a245-406e-a34d-903e9bd16aaa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:44.982365 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fff411d0-a245-406e-a34d-903e9bd16aaa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:44.986813 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fff411d0-a245-406e-a34d-903e9bd16aaa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:44.989897 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fff411d0-a245-406e-a34d-903e9bd16aaa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:44.989897 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fff411d0-a245-406e-a34d-903e9bd16aaa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:44.989897 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fff411d0-a245-406e-a34d-903e9bd16aaa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:45.351953 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:15:45.364506 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4f907138-7dbb-4037-a556-3cd633105211 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:45.372289 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4f907138-7dbb-4037-a556-3cd633105211 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:45.389212 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f907138-7dbb-4037-a556-3cd633105211 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:45.389900 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f907138-7dbb-4037-a556-3cd633105211 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:45.390393 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f907138-7dbb-4037-a556-3cd633105211 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:45.392784 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f907138-7dbb-4037-a556-3cd633105211 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:45.393598 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f907138-7dbb-4037-a556-3cd633105211 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:45.394211 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4f907138-7dbb-4037-a556-3cd633105211 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:45.420033 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=6 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:15:45.681782 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fff411d0-a245-406e-a34d-903e9bd16aaa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:45.691542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fff411d0-a245-406e-a34d-903e9bd16aaa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1521 microversion: 2.1 time: 0.731107 Sep 04 16:15:45.694659 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 132/254] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:44 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1521 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:45.698424 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-90149e62-7d87-41ab-b53f-039394db6507 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:15:45.699347 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-90149e62-7d87-41ab-b53f-039394db6507 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:45.707132 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90149e62-7d87-41ab-b53f-039394db6507 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:45.707834 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90149e62-7d87-41ab-b53f-039394db6507 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:45.708779 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90149e62-7d87-41ab-b53f-039394db6507 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:45.709768 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90149e62-7d87-41ab-b53f-039394db6507 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:45.710404 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90149e62-7d87-41ab-b53f-039394db6507 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:45.711017 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90149e62-7d87-41ab-b53f-039394db6507 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:45.747295 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-90149e62-7d87-41ab-b53f-039394db6507 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lazy-loading 'flavor' on Instance uuid 25192300-f22a-4b50-b390-17236f961eb5 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:15:46.371012 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4f907138-7dbb-4037-a556-3cd633105211 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:46.391046 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4f907138-7dbb-4037-a556-3cd633105211 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1314 microversion: 2.1 time: 1.053312 Sep 04 16:15:46.397930 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 123/255] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:45 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1314 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:46.424021 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-7a8b68bd-442f-4cd2-be32-323ec7f8cfe4 req-f64361f9-fb54-474d-8c89-1e94f012e6cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d92778a-fe09-4720-8b6c-a9f5a7aea57f", "tag": "af83fee5-86b0-448e-964a-b5a1fb38dc23"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:15:46.461111 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7a8b68bd-442f-4cd2-be32-323ec7f8cfe4 req-f64361f9-fb54-474d-8c89-1e94f012e6cc service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:46.461111 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7a8b68bd-442f-4cd2-be32-323ec7f8cfe4 req-f64361f9-fb54-474d-8c89-1e94f012e6cc service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:46.461111 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-7a8b68bd-442f-4cd2-be32-323ec7f8cfe4 req-f64361f9-fb54-474d-8c89-1e94f012e6cc service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:46.491236 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-90149e62-7d87-41ab-b53f-039394db6507 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "POST /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/action" status: 202 len: 0 microversion: 2.20 time: 0.797139 Sep 04 16:15:46.494434 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 133/256] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Sep 4 16:15:45 2022] POST /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/action => generated 0 bytes in 800 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 04 16:15:46.512187 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6d843248-1478-4422-b43c-69373f4bf047 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:46.514875 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6d843248-1478-4422-b43c-69373f4bf047 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:46.524459 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:15:46.524459 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-7a8b68bd-442f-4cd2-be32-323ec7f8cfe4 req-f64361f9-fb54-474d-8c89-1e94f012e6cc service nova] Creating event network-changed:af83fee5-86b0-448e-964a-b5a1fb38dc23 for instance 4d92778a-fe09-4720-8b6c-a9f5a7aea57f on hv-cinder-85236 Sep 04 16:15:46.549053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-7a8b68bd-442f-4cd2-be32-323ec7f8cfe4 req-f64361f9-fb54-474d-8c89-1e94f012e6cc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140063 Sep 04 16:15:46.549053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 124/257] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:15:46.551706 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6d843248-1478-4422-b43c-69373f4bf047 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:46.552383 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6d843248-1478-4422-b43c-69373f4bf047 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:46.553012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6d843248-1478-4422-b43c-69373f4bf047 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:46.554576 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6d843248-1478-4422-b43c-69373f4bf047 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:46.555510 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6d843248-1478-4422-b43c-69373f4bf047 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:46.556139 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6d843248-1478-4422-b43c-69373f4bf047 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:46.600527 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:15:46.926884 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aa1f7237-5d6a-4116-94a8-2cf9d31fe193 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Action: 'create', calling method: .version_select at 0x7f9689322670>, body: {"keypair": {"name": "tempest-TestShelveInstance-2067148300", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtneoqLDfHqTs8aVio1W0xnA1kE27MPRiPP9WA+TiJs76Bg/TzqRauNT7NqOezaEoI0yMHgmtVoNRwUYjmDu2K8wq8ywKts7mu/iCtvHeVspGl2agYN1A0MKgpGJHaWhQ=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:15:46.956204 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-aa1f7237-5d6a-4116-94a8-2cf9d31fe193 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Getting quotas for project 770dbd9183804e7fb0cbb99af75b45f2. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:15:46.961801 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-aa1f7237-5d6a-4116-94a8-2cf9d31fe193 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Getting quotas for user 7796ec614f2545c29c2739d3dfd889f4 and project 770dbd9183804e7fb0cbb99af75b45f2. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:15:47.042018 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aa1f7237-5d6a-4116-94a8-2cf9d31fe193 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.444171 Sep 04 16:15:47.055919 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 125/258] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Sep 4 16:15:46 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:15:47.067722 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ed0b2451-290b-4c41-8b80-8743c98a5fe6 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:47.070561 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ed0b2451-290b-4c41-8b80-8743c98a5fe6 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:47.088571 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed0b2451-290b-4c41-8b80-8743c98a5fe6 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:47.090931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed0b2451-290b-4c41-8b80-8743c98a5fe6 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:47.093003 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed0b2451-290b-4c41-8b80-8743c98a5fe6 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:47.095024 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed0b2451-290b-4c41-8b80-8743c98a5fe6 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:47.096871 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed0b2451-290b-4c41-8b80-8743c98a5fe6 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:47.099453 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed0b2451-290b-4c41-8b80-8743c98a5fe6 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:47.117509 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6d843248-1478-4422-b43c-69373f4bf047 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:47.126976 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6d843248-1478-4422-b43c-69373f4bf047 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:47.134460 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6d843248-1478-4422-b43c-69373f4bf047 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:47.135857 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6d843248-1478-4422-b43c-69373f4bf047 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1723 microversion: 2.20 time: 0.632548 Sep 04 16:15:47.138140 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 134/259] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:15:46 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1723 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:15:47.257950 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-10d08e6a-f4f1-42c8-978c-9dc3c085390c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:47.258320 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-10d08e6a-f4f1-42c8-978c-9dc3c085390c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:47.264645 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10d08e6a-f4f1-42c8-978c-9dc3c085390c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:47.265361 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10d08e6a-f4f1-42c8-978c-9dc3c085390c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:47.268133 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10d08e6a-f4f1-42c8-978c-9dc3c085390c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:47.269609 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10d08e6a-f4f1-42c8-978c-9dc3c085390c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:47.270403 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10d08e6a-f4f1-42c8-978c-9dc3c085390c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:47.272026 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10d08e6a-f4f1-42c8-978c-9dc3c085390c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:47.310925 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-10d08e6a-f4f1-42c8-978c-9dc3c085390c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/ips" status: 200 len: 151 microversion: 2.1 time: 0.057016 Sep 04 16:15:47.312187 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 135/260] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Sep 4 16:15:47 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/ips => generated 151 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:15:47.433596 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-63dc1cf0-03df-42f8-8423-6a6b0178741f tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:47.438680 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-63dc1cf0-03df-42f8-8423-6a6b0178741f tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:47.450569 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-63dc1cf0-03df-42f8-8423-6a6b0178741f tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:47.451464 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-63dc1cf0-03df-42f8-8423-6a6b0178741f tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:47.452146 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-63dc1cf0-03df-42f8-8423-6a6b0178741f tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:47.454639 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-63dc1cf0-03df-42f8-8423-6a6b0178741f tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:47.456656 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-63dc1cf0-03df-42f8-8423-6a6b0178741f tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:47.457378 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-63dc1cf0-03df-42f8-8423-6a6b0178741f tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:47.947425 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-63dc1cf0-03df-42f8-8423-6a6b0178741f tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:47.963117 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-63dc1cf0-03df-42f8-8423-6a6b0178741f tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1314 microversion: 2.1 time: 0.544816 Sep 04 16:15:47.963436 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ed0b2451-290b-4c41-8b80-8743c98a5fe6 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:47.974056 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 136/261] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:47 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1314 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:15:47.991003 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5e18a8b4-90fd-461a-81d2-69fdaefddc7b tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17f7ddab-a16d-4e85-aa04-8bb9fdd64362", "device": "/dev/sdb"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:15:47.994821 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ed0b2451-290b-4c41-8b80-8743c98a5fe6 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1521 microversion: 2.1 time: 0.931903 Sep 04 16:15:47.996081 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 126/262] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:47 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1521 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:48.004455 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5e18a8b4-90fd-461a-81d2-69fdaefddc7b tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:48.017896 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5e18a8b4-90fd-461a-81d2-69fdaefddc7b tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:48.018387 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5e18a8b4-90fd-461a-81d2-69fdaefddc7b tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:48.021115 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5e18a8b4-90fd-461a-81d2-69fdaefddc7b tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:48.024309 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5e18a8b4-90fd-461a-81d2-69fdaefddc7b tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:48.025042 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5e18a8b4-90fd-461a-81d2-69fdaefddc7b tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:48.025770 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5e18a8b4-90fd-461a-81d2-69fdaefddc7b tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:48.178181 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0c00f019-f56a-4a20-9c85-0f26df40ec72 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:48.180930 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0c00f019-f56a-4a20-9c85-0f26df40ec72 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:48.213671 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c00f019-f56a-4a20-9c85-0f26df40ec72 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:48.214633 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c00f019-f56a-4a20-9c85-0f26df40ec72 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:48.220409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c00f019-f56a-4a20-9c85-0f26df40ec72 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:48.223255 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c00f019-f56a-4a20-9c85-0f26df40ec72 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:48.225862 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c00f019-f56a-4a20-9c85-0f26df40ec72 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:48.227385 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c00f019-f56a-4a20-9c85-0f26df40ec72 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:48.700141 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0c00f019-f56a-4a20-9c85-0f26df40ec72 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:48.710042 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0c00f019-f56a-4a20-9c85-0f26df40ec72 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:48.711538 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0c00f019-f56a-4a20-9c85-0f26df40ec72 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:48.712733 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0c00f019-f56a-4a20-9c85-0f26df40ec72 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1723 microversion: 2.20 time: 0.547905 Sep 04 16:15:48.713367 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 127/263] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:15:48 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1723 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:15:48.989168 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ec9f87d2-9695-4bdb-bdc6-26b0689326bf tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:48.989865 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ec9f87d2-9695-4bdb-bdc6-26b0689326bf tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:48.998231 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec9f87d2-9695-4bdb-bdc6-26b0689326bf tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:48.999312 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec9f87d2-9695-4bdb-bdc6-26b0689326bf tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:48.999902 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec9f87d2-9695-4bdb-bdc6-26b0689326bf tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:49.000894 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec9f87d2-9695-4bdb-bdc6-26b0689326bf tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:49.001403 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec9f87d2-9695-4bdb-bdc6-26b0689326bf tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:49.001869 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec9f87d2-9695-4bdb-bdc6-26b0689326bf tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:49.288989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ec9f87d2-9695-4bdb-bdc6-26b0689326bf tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:49.311583 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ec9f87d2-9695-4bdb-bdc6-26b0689326bf tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1314 microversion: 2.1 time: 0.320513 Sep 04 16:15:49.312504 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 128/264] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:48 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:15:49.321076 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5b4e9cfe-f74e-427b-9258-fd725260b092 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:49.322499 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5b4e9cfe-f74e-427b-9258-fd725260b092 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:49.363935 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b4e9cfe-f74e-427b-9258-fd725260b092 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:49.368562 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b4e9cfe-f74e-427b-9258-fd725260b092 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:49.373011 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b4e9cfe-f74e-427b-9258-fd725260b092 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:49.376297 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b4e9cfe-f74e-427b-9258-fd725260b092 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:49.380508 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b4e9cfe-f74e-427b-9258-fd725260b092 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:49.381837 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b4e9cfe-f74e-427b-9258-fd725260b092 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:49.800506 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5b4e9cfe-f74e-427b-9258-fd725260b092 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:49.809710 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5b4e9cfe-f74e-427b-9258-fd725260b092 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1521 microversion: 2.1 time: 0.495753 Sep 04 16:15:49.810743 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 129/265] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:49 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1521 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:49.816269 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cdc20f1e-cffb-47d6-a124-97f53eb53ab5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba1e282e-3e59-40b4-b0e5-e7fae00d1bb4"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:15:49.827280 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cdc20f1e-cffb-47d6-a124-97f53eb53ab5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:49.836474 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdc20f1e-cffb-47d6-a124-97f53eb53ab5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:49.837201 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdc20f1e-cffb-47d6-a124-97f53eb53ab5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:49.842935 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdc20f1e-cffb-47d6-a124-97f53eb53ab5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:49.844267 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdc20f1e-cffb-47d6-a124-97f53eb53ab5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:49.844953 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdc20f1e-cffb-47d6-a124-97f53eb53ab5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:49.845538 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdc20f1e-cffb-47d6-a124-97f53eb53ab5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:50.073909 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5e18a8b4-90fd-461a-81d2-69fdaefddc7b tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "POST /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.098381 Sep 04 16:15:50.081028 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 137/266] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Sep 4 16:15:47 2022] POST /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5/os-volume_attachments => generated 194 bytes in 2106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:15:50.091363 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f7fe30cd-fbb7-4fa4-ab5c-7e451874678a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:50.093637 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f7fe30cd-fbb7-4fa4-ab5c-7e451874678a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:50.124028 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f7fe30cd-fbb7-4fa4-ab5c-7e451874678a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:50.126174 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f7fe30cd-fbb7-4fa4-ab5c-7e451874678a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:50.126860 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f7fe30cd-fbb7-4fa4-ab5c-7e451874678a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:50.131129 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f7fe30cd-fbb7-4fa4-ab5c-7e451874678a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:50.131129 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f7fe30cd-fbb7-4fa4-ab5c-7e451874678a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:50.131129 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f7fe30cd-fbb7-4fa4-ab5c-7e451874678a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:50.782961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f7fe30cd-fbb7-4fa4-ab5c-7e451874678a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:50.798445 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f7fe30cd-fbb7-4fa4-ab5c-7e451874678a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:50.800925 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f7fe30cd-fbb7-4fa4-ab5c-7e451874678a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:50.802335 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f7fe30cd-fbb7-4fa4-ab5c-7e451874678a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1723 microversion: 2.20 time: 0.719603 Sep 04 16:15:50.803040 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 138/267] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:15:50 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1723 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:15:50.808176 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-93387434-a774-43c9-a80d-7e3d662c3924 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:50.809198 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-93387434-a774-43c9-a80d-7e3d662c3924 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:50.817000 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-93387434-a774-43c9-a80d-7e3d662c3924 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:50.818010 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-93387434-a774-43c9-a80d-7e3d662c3924 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:50.819029 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-93387434-a774-43c9-a80d-7e3d662c3924 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:50.820034 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-93387434-a774-43c9-a80d-7e3d662c3924 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:50.820700 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-93387434-a774-43c9-a80d-7e3d662c3924 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:50.821323 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-93387434-a774-43c9-a80d-7e3d662c3924 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:51.121132 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cdc20f1e-cffb-47d6-a124-97f53eb53ab5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "POST /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.308697 Sep 04 16:15:51.122511 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 130/268] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Sep 4 16:15:49 2022] POST /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments => generated 194 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:15:51.130363 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bb5ef1f7-29c6-4f85-8e95-6482b46a606b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:51.131442 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bb5ef1f7-29c6-4f85-8e95-6482b46a606b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:51.141232 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb5ef1f7-29c6-4f85-8e95-6482b46a606b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:51.142421 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb5ef1f7-29c6-4f85-8e95-6482b46a606b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:51.147614 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb5ef1f7-29c6-4f85-8e95-6482b46a606b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:51.148686 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb5ef1f7-29c6-4f85-8e95-6482b46a606b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:51.149763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb5ef1f7-29c6-4f85-8e95-6482b46a606b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:51.155900 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb5ef1f7-29c6-4f85-8e95-6482b46a606b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:51.575086 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-93387434-a774-43c9-a80d-7e3d662c3924 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:51.588801 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-93387434-a774-43c9-a80d-7e3d662c3924 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1314 microversion: 2.1 time: 0.782413 Sep 04 16:15:51.591422 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 139/269] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:50 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1314 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:51.690470 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-bb5ef1f7-29c6-4f85-8e95-6482b46a606b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:51.698655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bb5ef1f7-29c6-4f85-8e95-6482b46a606b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1521 microversion: 2.1 time: 0.574315 Sep 04 16:15:51.699598 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 131/270] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:51 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1521 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:51.838571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e4a71682-7893-42ef-b8a6-3ae53f57fea6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:51.839566 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e4a71682-7893-42ef-b8a6-3ae53f57fea6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:51.846904 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e4a71682-7893-42ef-b8a6-3ae53f57fea6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:51.847554 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e4a71682-7893-42ef-b8a6-3ae53f57fea6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:51.848153 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e4a71682-7893-42ef-b8a6-3ae53f57fea6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:51.849426 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e4a71682-7893-42ef-b8a6-3ae53f57fea6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:51.850172 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e4a71682-7893-42ef-b8a6-3ae53f57fea6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:51.851128 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e4a71682-7893-42ef-b8a6-3ae53f57fea6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:52.182473 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e4a71682-7893-42ef-b8a6-3ae53f57fea6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:52.200731 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e4a71682-7893-42ef-b8a6-3ae53f57fea6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:52.216930 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e4a71682-7893-42ef-b8a6-3ae53f57fea6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:52.218547 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e4a71682-7893-42ef-b8a6-3ae53f57fea6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1723 microversion: 2.20 time: 0.386270 Sep 04 16:15:52.225548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 140/271] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:15:51 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1723 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:15:52.621461 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-378c51ae-c444-45ae-b3c0-26fa64675e0c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:52.622208 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-378c51ae-c444-45ae-b3c0-26fa64675e0c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:52.629211 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:15:52.631475 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-378c51ae-c444-45ae-b3c0-26fa64675e0c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:52.631961 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-378c51ae-c444-45ae-b3c0-26fa64675e0c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:52.632394 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-378c51ae-c444-45ae-b3c0-26fa64675e0c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:52.633099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-378c51ae-c444-45ae-b3c0-26fa64675e0c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:52.633552 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-378c51ae-c444-45ae-b3c0-26fa64675e0c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:52.633991 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-378c51ae-c444-45ae-b3c0-26fa64675e0c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:52.730491 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-bf3d80b9-6b4f-4296-a2be-f43a448d2a6a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:52.732678 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-bf3d80b9-6b4f-4296-a2be-f43a448d2a6a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:52.757847 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf3d80b9-6b4f-4296-a2be-f43a448d2a6a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:52.762095 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf3d80b9-6b4f-4296-a2be-f43a448d2a6a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:52.763800 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf3d80b9-6b4f-4296-a2be-f43a448d2a6a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:52.765331 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf3d80b9-6b4f-4296-a2be-f43a448d2a6a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:52.766107 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf3d80b9-6b4f-4296-a2be-f43a448d2a6a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:52.766867 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bf3d80b9-6b4f-4296-a2be-f43a448d2a6a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:53.018197 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-378c51ae-c444-45ae-b3c0-26fa64675e0c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:53.030231 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-378c51ae-c444-45ae-b3c0-26fa64675e0c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1314 microversion: 2.1 time: 0.411504 Sep 04 16:15:53.038131 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 132/272] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:52 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:53.106061 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bf3d80b9-6b4f-4296-a2be-f43a448d2a6a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:53.117488 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-bf3d80b9-6b4f-4296-a2be-f43a448d2a6a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1521 microversion: 2.1 time: 0.396591 Sep 04 16:15:53.118565 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 141/273] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:52 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:53.256174 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bf0ddb5d-7793-48e3-9bd0-9160bd7b63bb tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:53.257036 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bf0ddb5d-7793-48e3-9bd0-9160bd7b63bb tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:53.268672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf0ddb5d-7793-48e3-9bd0-9160bd7b63bb tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:53.269603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf0ddb5d-7793-48e3-9bd0-9160bd7b63bb tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:53.270818 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf0ddb5d-7793-48e3-9bd0-9160bd7b63bb tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:53.273055 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf0ddb5d-7793-48e3-9bd0-9160bd7b63bb tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:53.273763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf0ddb5d-7793-48e3-9bd0-9160bd7b63bb tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:53.274503 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bf0ddb5d-7793-48e3-9bd0-9160bd7b63bb tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:53.519313 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-bf0ddb5d-7793-48e3-9bd0-9160bd7b63bb tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:53.533908 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-bf0ddb5d-7793-48e3-9bd0-9160bd7b63bb tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:53.536712 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-bf0ddb5d-7793-48e3-9bd0-9160bd7b63bb tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:53.538795 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bf0ddb5d-7793-48e3-9bd0-9160bd7b63bb tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1723 microversion: 2.20 time: 0.288984 Sep 04 16:15:53.540726 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 133/274] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:15:53 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:15:54.060690 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-642ec155-59a8-4732-8c5d-3469ed1d8e0c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:54.064640 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-642ec155-59a8-4732-8c5d-3469ed1d8e0c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:54.075568 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-642ec155-59a8-4732-8c5d-3469ed1d8e0c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:54.091274 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-642ec155-59a8-4732-8c5d-3469ed1d8e0c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:54.091274 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-642ec155-59a8-4732-8c5d-3469ed1d8e0c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:54.091274 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-642ec155-59a8-4732-8c5d-3469ed1d8e0c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:54.091274 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-642ec155-59a8-4732-8c5d-3469ed1d8e0c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:54.091784 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-642ec155-59a8-4732-8c5d-3469ed1d8e0c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:54.144454 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-89333e47-1920-40de-b652-a70719a41266 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:54.145700 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-89333e47-1920-40de-b652-a70719a41266 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:54.154291 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89333e47-1920-40de-b652-a70719a41266 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:54.155162 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89333e47-1920-40de-b652-a70719a41266 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:54.155794 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89333e47-1920-40de-b652-a70719a41266 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:54.157287 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89333e47-1920-40de-b652-a70719a41266 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:54.158075 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89333e47-1920-40de-b652-a70719a41266 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:54.158666 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-89333e47-1920-40de-b652-a70719a41266 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:54.594750 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-89333e47-1920-40de-b652-a70719a41266 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:54.616576 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-89333e47-1920-40de-b652-a70719a41266 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1521 microversion: 2.1 time: 0.478434 Sep 04 16:15:54.617350 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 134/275] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:54 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1521 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:54.635516 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2bd955e5-268e-45bd-93a5-569ea8338c4c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:54.635516 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2bd955e5-268e-45bd-93a5-569ea8338c4c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:54.666673 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2bd955e5-268e-45bd-93a5-569ea8338c4c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:54.667161 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2bd955e5-268e-45bd-93a5-569ea8338c4c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:54.667606 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2bd955e5-268e-45bd-93a5-569ea8338c4c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:54.668691 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2bd955e5-268e-45bd-93a5-569ea8338c4c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:54.668809 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2bd955e5-268e-45bd-93a5-569ea8338c4c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:54.669184 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2bd955e5-268e-45bd-93a5-569ea8338c4c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:54.759170 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-642ec155-59a8-4732-8c5d-3469ed1d8e0c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:54.784889 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-642ec155-59a8-4732-8c5d-3469ed1d8e0c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1314 microversion: 2.1 time: 0.726991 Sep 04 16:15:54.784889 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 142/276] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:54 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1314 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:54.808548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-77d6a7b2-9114-43c4-9f5c-b126b29a0dbe req-7a04ebca-368c-4b57-b079-23a533f9c553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d92778a-fe09-4720-8b6c-a9f5a7aea57f", "name": "network-vif-plugged", "status": "completed", "tag": "af83fee5-86b0-448e-964a-b5a1fb38dc23"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:15:54.819526 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-77d6a7b2-9114-43c4-9f5c-b126b29a0dbe req-7a04ebca-368c-4b57-b079-23a533f9c553 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:54.820195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-77d6a7b2-9114-43c4-9f5c-b126b29a0dbe req-7a04ebca-368c-4b57-b079-23a533f9c553 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:54.820782 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-77d6a7b2-9114-43c4-9f5c-b126b29a0dbe req-7a04ebca-368c-4b57-b079-23a533f9c553 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:54.956498 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2bd955e5-268e-45bd-93a5-569ea8338c4c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:54.971236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2bd955e5-268e-45bd-93a5-569ea8338c4c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:54.972735 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2bd955e5-268e-45bd-93a5-569ea8338c4c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:54.973977 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2bd955e5-268e-45bd-93a5-569ea8338c4c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1723 microversion: 2.20 time: 0.355301 Sep 04 16:15:54.976880 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 135/277] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:15:54 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1723 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:15:55.032776 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-77d6a7b2-9114-43c4-9f5c-b126b29a0dbe req-7a04ebca-368c-4b57-b079-23a533f9c553 service nova] Creating event network-vif-plugged:af83fee5-86b0-448e-964a-b5a1fb38dc23 for instance 4d92778a-fe09-4720-8b6c-a9f5a7aea57f on hv-cinder-85236 Sep 04 16:15:55.040541 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-77d6a7b2-9114-43c4-9f5c-b126b29a0dbe req-7a04ebca-368c-4b57-b079-23a533f9c553 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.237869 Sep 04 16:15:55.041507 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 143/278] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:15:55.237010 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-31f9de19-a10f-4db2-a028-9d0c861b86dd tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Action: 'create', calling method: .version_select at 0x7f968944f550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2049353985", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcUw5fJXWCuuCGNSKCzrQToHh4KDFU0/n/HNnlVhelyvcKKiAIp8KOB6oxCWPupkckkfl8XUDGpV12HxlS3BaVm3A+c7wHTIGIjJfBLzuAGCDwajdtWSyECh1YMa9qLig=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:15:55.252354 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-31f9de19-a10f-4db2-a028-9d0c861b86dd tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Getting quotas for project 56e82ba24a474557af758826743136d9. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:15:55.256272 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-31f9de19-a10f-4db2-a028-9d0c861b86dd tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Getting quotas for user b694f1163ef54b82b86e06bf825c57e4 and project 56e82ba24a474557af758826743136d9. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:15:55.366659 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-31f9de19-a10f-4db2-a028-9d0c861b86dd tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.250601 Sep 04 16:15:55.367367 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 136/279] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Sep 4 16:15:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:15:55.642887 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-59946d49-fd61-4756-86fd-e9f815bc4e52 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:55.643674 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-59946d49-fd61-4756-86fd-e9f815bc4e52 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:55.649890 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-59946d49-fd61-4756-86fd-e9f815bc4e52 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:55.658329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-59946d49-fd61-4756-86fd-e9f815bc4e52 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:55.658329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-59946d49-fd61-4756-86fd-e9f815bc4e52 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:55.658329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-59946d49-fd61-4756-86fd-e9f815bc4e52 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:55.658329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-59946d49-fd61-4756-86fd-e9f815bc4e52 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:55.659255 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-59946d49-fd61-4756-86fd-e9f815bc4e52 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:55.809720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-82ad9858-058b-4181-b5ae-559a7200431c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:55.815129 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-82ad9858-058b-4181-b5ae-559a7200431c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:55.841880 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82ad9858-058b-4181-b5ae-559a7200431c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:55.842542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82ad9858-058b-4181-b5ae-559a7200431c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:55.843000 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82ad9858-058b-4181-b5ae-559a7200431c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:55.844476 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82ad9858-058b-4181-b5ae-559a7200431c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:55.844995 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82ad9858-058b-4181-b5ae-559a7200431c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:55.845401 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-82ad9858-058b-4181-b5ae-559a7200431c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:55.846386 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-59946d49-fd61-4756-86fd-e9f815bc4e52 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:55.868498 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-59946d49-fd61-4756-86fd-e9f815bc4e52 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1521 microversion: 2.1 time: 0.230889 Sep 04 16:15:55.869090 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 144/280] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:55 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:15:56.004439 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-57d6f592-00af-4670-b426-cfd9097dffd8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:56.005057 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-57d6f592-00af-4670-b426-cfd9097dffd8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:56.014117 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57d6f592-00af-4670-b426-cfd9097dffd8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:56.017871 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57d6f592-00af-4670-b426-cfd9097dffd8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:56.018510 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57d6f592-00af-4670-b426-cfd9097dffd8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:56.019437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57d6f592-00af-4670-b426-cfd9097dffd8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:56.020112 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57d6f592-00af-4670-b426-cfd9097dffd8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:56.020735 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-57d6f592-00af-4670-b426-cfd9097dffd8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:56.067292 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-82ad9858-058b-4181-b5ae-559a7200431c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:56.079556 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-82ad9858-058b-4181-b5ae-559a7200431c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1314 microversion: 2.1 time: 0.275155 Sep 04 16:15:56.079840 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 137/281] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:55 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:56.313917 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-57d6f592-00af-4670-b426-cfd9097dffd8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:56.316810 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-57d6f592-00af-4670-b426-cfd9097dffd8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:56.316810 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-57d6f592-00af-4670-b426-cfd9097dffd8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:56.319288 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-57d6f592-00af-4670-b426-cfd9097dffd8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1723 microversion: 2.20 time: 0.320023 Sep 04 16:15:56.321733 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 145/282] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:15:55 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:15:56.895048 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eeddbaac-5729-426f-b1d2-5e3bab624396 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:56.896248 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eeddbaac-5729-426f-b1d2-5e3bab624396 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:56.903002 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eeddbaac-5729-426f-b1d2-5e3bab624396 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:56.903491 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eeddbaac-5729-426f-b1d2-5e3bab624396 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:56.903926 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eeddbaac-5729-426f-b1d2-5e3bab624396 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:56.904779 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eeddbaac-5729-426f-b1d2-5e3bab624396 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:56.905239 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eeddbaac-5729-426f-b1d2-5e3bab624396 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:56.905955 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eeddbaac-5729-426f-b1d2-5e3bab624396 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:57.107068 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9d5165cc-16ff-461a-abf2-8c4c51be9630 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:57.107735 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9d5165cc-16ff-461a-abf2-8c4c51be9630 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:57.114787 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-eeddbaac-5729-426f-b1d2-5e3bab624396 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:57.116438 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d5165cc-16ff-461a-abf2-8c4c51be9630 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:57.117120 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d5165cc-16ff-461a-abf2-8c4c51be9630 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:57.117640 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d5165cc-16ff-461a-abf2-8c4c51be9630 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:57.118515 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d5165cc-16ff-461a-abf2-8c4c51be9630 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:57.118976 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d5165cc-16ff-461a-abf2-8c4c51be9630 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:57.119617 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d5165cc-16ff-461a-abf2-8c4c51be9630 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:57.122887 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eeddbaac-5729-426f-b1d2-5e3bab624396 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1521 microversion: 2.1 time: 0.232388 Sep 04 16:15:57.123458 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 138/283] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:56 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:57.271986 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9d5165cc-16ff-461a-abf2-8c4c51be9630 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:57.280128 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9d5165cc-16ff-461a-abf2-8c4c51be9630 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1314 microversion: 2.1 time: 0.178360 Sep 04 16:15:57.280711 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 146/284] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:57 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:57.350863 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ffde5b72-6dcc-45c6-8ae5-91a00bc9b73c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:57.352773 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ffde5b72-6dcc-45c6-8ae5-91a00bc9b73c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:57.360110 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffde5b72-6dcc-45c6-8ae5-91a00bc9b73c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:57.360777 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffde5b72-6dcc-45c6-8ae5-91a00bc9b73c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:57.362833 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffde5b72-6dcc-45c6-8ae5-91a00bc9b73c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:57.362833 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffde5b72-6dcc-45c6-8ae5-91a00bc9b73c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:57.363204 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffde5b72-6dcc-45c6-8ae5-91a00bc9b73c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:57.363888 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ffde5b72-6dcc-45c6-8ae5-91a00bc9b73c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:57.514766 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ffde5b72-6dcc-45c6-8ae5-91a00bc9b73c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:57.523113 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ffde5b72-6dcc-45c6-8ae5-91a00bc9b73c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:57.524553 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ffde5b72-6dcc-45c6-8ae5-91a00bc9b73c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:57.525751 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ffde5b72-6dcc-45c6-8ae5-91a00bc9b73c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1723 microversion: 2.20 time: 0.180762 Sep 04 16:15:57.526343 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 139/285] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:15:57 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:15:58.149299 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-dec0c737-31f6-4265-82cd-44e3bfb38cbd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:58.149952 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-dec0c737-31f6-4265-82cd-44e3bfb38cbd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:58.158761 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dec0c737-31f6-4265-82cd-44e3bfb38cbd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:58.159571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dec0c737-31f6-4265-82cd-44e3bfb38cbd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:58.160166 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dec0c737-31f6-4265-82cd-44e3bfb38cbd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:58.161035 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dec0c737-31f6-4265-82cd-44e3bfb38cbd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:58.161692 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dec0c737-31f6-4265-82cd-44e3bfb38cbd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:58.162325 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dec0c737-31f6-4265-82cd-44e3bfb38cbd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:58.309779 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-dec0c737-31f6-4265-82cd-44e3bfb38cbd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:58.312198 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4ac76f28-aa06-4443-9174-555c486075ea tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:58.312976 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4ac76f28-aa06-4443-9174-555c486075ea tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:58.321143 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ac76f28-aa06-4443-9174-555c486075ea tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:58.322367 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ac76f28-aa06-4443-9174-555c486075ea tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:58.323074 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ac76f28-aa06-4443-9174-555c486075ea tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:58.324352 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ac76f28-aa06-4443-9174-555c486075ea tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:58.325020 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ac76f28-aa06-4443-9174-555c486075ea tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:58.325888 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ac76f28-aa06-4443-9174-555c486075ea tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:58.328209 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-dec0c737-31f6-4265-82cd-44e3bfb38cbd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1521 microversion: 2.1 time: 0.180533 Sep 04 16:15:58.342546 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 147/286] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:58 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:58.494232 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4ac76f28-aa06-4443-9174-555c486075ea tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:58.503695 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4ac76f28-aa06-4443-9174-555c486075ea tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1314 microversion: 2.1 time: 0.203225 Sep 04 16:15:58.504488 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 140/287] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:58 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:58.553876 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-802de28f-60f6-4be8-952e-30e34d6615f9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:58.554491 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-802de28f-60f6-4be8-952e-30e34d6615f9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:58.560363 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-802de28f-60f6-4be8-952e-30e34d6615f9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:58.561025 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-802de28f-60f6-4be8-952e-30e34d6615f9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:58.561454 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-802de28f-60f6-4be8-952e-30e34d6615f9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:58.562168 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-802de28f-60f6-4be8-952e-30e34d6615f9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:58.562663 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-802de28f-60f6-4be8-952e-30e34d6615f9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:58.563246 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-802de28f-60f6-4be8-952e-30e34d6615f9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:58.715587 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-802de28f-60f6-4be8-952e-30e34d6615f9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:58.726094 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-802de28f-60f6-4be8-952e-30e34d6615f9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:58.728109 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-802de28f-60f6-4be8-952e-30e34d6615f9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:58.729412 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-802de28f-60f6-4be8-952e-30e34d6615f9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1723 microversion: 2.20 time: 0.179883 Sep 04 16:15:58.733638 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 148/288] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:15:58 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:15:59.360479 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-843f6ab5-844f-4705-a0bc-eb37524bb658 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:59.360479 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-843f6ab5-844f-4705-a0bc-eb37524bb658 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:59.372732 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-843f6ab5-844f-4705-a0bc-eb37524bb658 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:59.373303 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-843f6ab5-844f-4705-a0bc-eb37524bb658 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:59.374018 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-843f6ab5-844f-4705-a0bc-eb37524bb658 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:59.378896 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-843f6ab5-844f-4705-a0bc-eb37524bb658 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:59.380210 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-843f6ab5-844f-4705-a0bc-eb37524bb658 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:59.381093 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-843f6ab5-844f-4705-a0bc-eb37524bb658 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:59.528210 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b26e36c1-2911-43fe-a592-38dd842f8267 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:59.529408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b26e36c1-2911-43fe-a592-38dd842f8267 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:59.541757 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b26e36c1-2911-43fe-a592-38dd842f8267 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:59.544867 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b26e36c1-2911-43fe-a592-38dd842f8267 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:59.545321 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b26e36c1-2911-43fe-a592-38dd842f8267 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:59.546077 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b26e36c1-2911-43fe-a592-38dd842f8267 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:59.548567 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b26e36c1-2911-43fe-a592-38dd842f8267 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:59.549025 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b26e36c1-2911-43fe-a592-38dd842f8267 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:59.644672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-843f6ab5-844f-4705-a0bc-eb37524bb658 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:59.652148 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-843f6ab5-844f-4705-a0bc-eb37524bb658 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1501 microversion: 2.1 time: 0.299937 Sep 04 16:15:59.653094 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 141/289] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:59 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1501 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:15:59.676566 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-deab9c38-9ff3-4975-98e9-92eebf5b0c08 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0f6f188-7bbb-4b49-8c2c-68565ff2d6b3"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:15:59.679211 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-deab9c38-9ff3-4975-98e9-92eebf5b0c08 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:59.685391 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-deab9c38-9ff3-4975-98e9-92eebf5b0c08 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:59.687788 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-deab9c38-9ff3-4975-98e9-92eebf5b0c08 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:59.687788 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-deab9c38-9ff3-4975-98e9-92eebf5b0c08 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:59.687788 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-deab9c38-9ff3-4975-98e9-92eebf5b0c08 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:59.688086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-deab9c38-9ff3-4975-98e9-92eebf5b0c08 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:59.688830 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-deab9c38-9ff3-4975-98e9-92eebf5b0c08 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:59.692739 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:15:59.713027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-deab9c38-9ff3-4975-98e9-92eebf5b0c08 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] HTTP exception thrown: Cannot 'attach_volume' instance ee1afbcb-161b-4255-af5d-7aa20d2bf66f while it is in vm_state rescued Sep 04 16:15:59.715236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-deab9c38-9ff3-4975-98e9-92eebf5b0c08 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Request method failure captured: Sep 04 16:15:59.715236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f/os-volume_attachments HTTP/1.1 Sep 04 16:15:59.715236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:15:59.715236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:15:59.715236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:15:59.715236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 74 Sep 04 16:15:59.715236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:15:59.715236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:15:59.715236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:15:59.715236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:15:59.715236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFM7AQu8qea0BFPhZJJD1SjpMjCb9OT3yqcZNamIbdv_2tiOBslm23HUMyFLRuEja9zOxHSb7HCyTIWbzZ5oqcjUZcQ0rElKr7qovko9hAD8HBN652TVbu8E6ygcWWlMFsAALAQQiHxyfrlUQj8PuQ9eIFVlDfwklsO4cKSYRuTyg9y4 Sep 04 16:15:59.715236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:15:59.715236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:15:59.715236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:15:59.715236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:15:59.715236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:15:59.715236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:15:59.715236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: cb043a0ecad3466bbd5a5874126d2810 Sep 04 16:15:59.715236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1718450479 Sep 04 16:15:59.715236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:15:59.715236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:15:59.717409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cb043a0ecad3466bbd5a5874126d2810"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb043a0ecad3466bbd5a5874126d2810"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cb043a0ecad3466bbd5a5874126d2810", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb043a0ecad3466bbd5a5874126d2810"}]}] Sep 04 16:15:59.717409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1718450479 Sep 04 16:15:59.717409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: cb043a0ecad3466bbd5a5874126d2810 Sep 04 16:15:59.717409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1718450479 Sep 04 16:15:59.717409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-ServerRescueNegativeTestJSON-1718450479-project Sep 04 16:15:59.717409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:15:59.717409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:15:59.717409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: a9d55c52717546b09d93d956a29f49a9 Sep 04 16:15:59.717409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1718450479-project Sep 04 16:15:59.717409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Sep 04 16:15:59.717409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {"volumeAttachment": {"volumeId": "f0f6f188-7bbb-4b49-8c2c-68565ff2d6b3"}} Sep 04 16:15:59.717409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: > Sep 04 16:15:59.718433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Cannot 'attach_volume' instance ee1afbcb-161b-4255-af5d-7aa20d2bf66f while it is in vm_state rescued Sep 04 16:15:59.718433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'server_id': 'ee1afbcb-161b-4255-af5d-7aa20d2bf66f', 'body': {'volumeAttachment': {'volumeId': 'f0f6f188-7bbb-4b49-8c2c-68565ff2d6b3'}}} Sep 04 16:15:59.718433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:15:59.718433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:15:59.718433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 04 16:15:59.718433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 04 16:15:59.718433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 04 16:15:59.718433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 04 16:15:59.718433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 04 16:15:59.718433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 04 16:15:59.718433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ee1afbcb-161b-4255-af5d-7aa20d2bf66f in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 04 16:15:59.718433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:15:59.718433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:15:59.718433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:15:59.718433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:15:59.718433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:15:59.718433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:15:59.718433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:15:59.718433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:15:59.720331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:15:59.720331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:15:59.720331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 04 16:15:59.720331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 04 16:15:59.720331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 04 16:15:59.720331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 04 16:15:59.720331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 04 16:15:59.720331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 04 16:15:59.720331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 04 16:15:59.720331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 04 16:15:59.720331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 04 16:15:59.720331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 04 16:15:59.720331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ee1afbcb-161b-4255-af5d-7aa20d2bf66f while it is in vm_state rescued Sep 04 16:15:59.720331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:15:59.720331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:15:59.720331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:15:59.720331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:15:59.720331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:15:59.720331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:15:59.721500 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:15:59.721500 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:15:59.721500 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ee1afbcb-161b-4255-af5d-7aa20d2bf66f while it is in vm_state rescued Sep 04 16:15:59.721500 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:15:59.721880 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b26e36c1-2911-43fe-a592-38dd842f8267 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:59.722058 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-deab9c38-9ff3-4975-98e9-92eebf5b0c08 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Returning 409 to user: Cannot 'attach_volume' instance ee1afbcb-161b-4255-af5d-7aa20d2bf66f while it is in vm_state rescued {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:15:59.722058 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-deab9c38-9ff3-4975-98e9-92eebf5b0c08 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "POST /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044882 Sep 04 16:15:59.722058 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 142/290] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Sep 4 16:15:59 2022] POST /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 04 16:15:59.725642 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b26e36c1-2911-43fe-a592-38dd842f8267 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1314 microversion: 2.1 time: 0.201853 Sep 04 16:15:59.726227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 149/291] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:59 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:15:59.726516 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-94a53e6b-57ba-419c-a5c6-f1d72ed97cd5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:15:59.727049 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-94a53e6b-57ba-419c-a5c6-f1d72ed97cd5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:59.733153 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94a53e6b-57ba-419c-a5c6-f1d72ed97cd5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:59.734089 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94a53e6b-57ba-419c-a5c6-f1d72ed97cd5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:59.734801 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94a53e6b-57ba-419c-a5c6-f1d72ed97cd5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:59.738942 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94a53e6b-57ba-419c-a5c6-f1d72ed97cd5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:59.738942 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94a53e6b-57ba-419c-a5c6-f1d72ed97cd5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:59.738942 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-94a53e6b-57ba-419c-a5c6-f1d72ed97cd5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:59.756380 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-69042f3e-51fd-4602-8f00-fe10586d3019 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:59.757145 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-69042f3e-51fd-4602-8f00-fe10586d3019 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:15:59.763875 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69042f3e-51fd-4602-8f00-fe10586d3019 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:59.769282 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69042f3e-51fd-4602-8f00-fe10586d3019 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:59.769282 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69042f3e-51fd-4602-8f00-fe10586d3019 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:59.769282 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69042f3e-51fd-4602-8f00-fe10586d3019 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:15:59.769282 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69042f3e-51fd-4602-8f00-fe10586d3019 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:15:59.770401 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69042f3e-51fd-4602-8f00-fe10586d3019 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:15:59.933938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-69042f3e-51fd-4602-8f00-fe10586d3019 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:59.938851 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-94a53e6b-57ba-419c-a5c6-f1d72ed97cd5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "POST /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f/action" status: 202 len: 0 microversion: 2.1 time: 0.216010 Sep 04 16:15:59.939562 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 143/292] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Sep 4 16:15:59 2022] POST /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:15:59.944998 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:15:59.956832 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-69042f3e-51fd-4602-8f00-fe10586d3019 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:59.958494 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-69042f3e-51fd-4602-8f00-fe10586d3019 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:15:59.959931 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-69042f3e-51fd-4602-8f00-fe10586d3019 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1723 microversion: 2.20 time: 0.208350 Sep 04 16:15:59.973710 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 150/293] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:15:59 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:15:59.978241 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8345435f-977a-4d92-a1e7-99a1a69246f7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:15:59.980830 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8345435f-977a-4d92-a1e7-99a1a69246f7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:00.008595 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8345435f-977a-4d92-a1e7-99a1a69246f7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:00.010239 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8345435f-977a-4d92-a1e7-99a1a69246f7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:00.010873 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8345435f-977a-4d92-a1e7-99a1a69246f7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:00.011787 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8345435f-977a-4d92-a1e7-99a1a69246f7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:00.013167 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8345435f-977a-4d92-a1e7-99a1a69246f7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:00.013798 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8345435f-977a-4d92-a1e7-99a1a69246f7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:00.253895 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-8345435f-977a-4d92-a1e7-99a1a69246f7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:00.271064 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8345435f-977a-4d92-a1e7-99a1a69246f7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1509 microversion: 2.1 time: 0.312941 Sep 04 16:16:00.274921 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 144/294] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:15:59 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1509 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:00.748296 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d5b82dd0-2a8c-428b-9a5f-ec18332e162c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:00.748896 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d5b82dd0-2a8c-428b-9a5f-ec18332e162c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:00.756288 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d5b82dd0-2a8c-428b-9a5f-ec18332e162c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:00.756763 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d5b82dd0-2a8c-428b-9a5f-ec18332e162c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:00.757187 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d5b82dd0-2a8c-428b-9a5f-ec18332e162c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:00.757977 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d5b82dd0-2a8c-428b-9a5f-ec18332e162c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:00.758425 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d5b82dd0-2a8c-428b-9a5f-ec18332e162c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:00.758840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d5b82dd0-2a8c-428b-9a5f-ec18332e162c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:00.900037 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d5b82dd0-2a8c-428b-9a5f-ec18332e162c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:00.908978 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d5b82dd0-2a8c-428b-9a5f-ec18332e162c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1463 microversion: 2.1 time: 0.164540 Sep 04 16:16:00.909955 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 151/295] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:00 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1463 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:00.956157 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e4f805db-c25f-4cdc-bde2-7199f26870e0 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:00.956789 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e4f805db-c25f-4cdc-bde2-7199f26870e0 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:00.963702 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4f805db-c25f-4cdc-bde2-7199f26870e0 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:00.964188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4f805db-c25f-4cdc-bde2-7199f26870e0 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:00.964620 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4f805db-c25f-4cdc-bde2-7199f26870e0 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:00.965322 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4f805db-c25f-4cdc-bde2-7199f26870e0 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:00.965812 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4f805db-c25f-4cdc-bde2-7199f26870e0 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:00.966230 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e4f805db-c25f-4cdc-bde2-7199f26870e0 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:00.988832 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-dea1a7bc-1375-4cf3-8bf5-f88ce0f9f29a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:00.989437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-dea1a7bc-1375-4cf3-8bf5-f88ce0f9f29a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:00.993392 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e4f805db-c25f-4cdc-bde2-7199f26870e0 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 16:16:00.995342 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dea1a7bc-1375-4cf3-8bf5-f88ce0f9f29a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:00.995852 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dea1a7bc-1375-4cf3-8bf5-f88ce0f9f29a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:00.996483 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dea1a7bc-1375-4cf3-8bf5-f88ce0f9f29a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:00.997177 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dea1a7bc-1375-4cf3-8bf5-f88ce0f9f29a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:00.997657 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dea1a7bc-1375-4cf3-8bf5-f88ce0f9f29a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:00.998106 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dea1a7bc-1375-4cf3-8bf5-f88ce0f9f29a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:01.130121 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-dea1a7bc-1375-4cf3-8bf5-f88ce0f9f29a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:01.138428 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-dea1a7bc-1375-4cf3-8bf5-f88ce0f9f29a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:01.139890 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-dea1a7bc-1375-4cf3-8bf5-f88ce0f9f29a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:01.141643 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-dea1a7bc-1375-4cf3-8bf5-f88ce0f9f29a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1723 microversion: 2.20 time: 0.156647 Sep 04 16:16:01.142207 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 152/296] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:00 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:16:01.268378 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e4f805db-c25f-4cdc-bde2-7199f26870e0 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 204 len: 0 microversion: 2.1 time: 0.316322 Sep 04 16:16:01.268959 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 145/297] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:16:00 2022] DELETE /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 16:16:01.277022 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cd0b20ac-b3a5-4627-beca-6c3980985c5b tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:01.277658 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cd0b20ac-b3a5-4627-beca-6c3980985c5b tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:01.283855 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd0b20ac-b3a5-4627-beca-6c3980985c5b tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:01.284339 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd0b20ac-b3a5-4627-beca-6c3980985c5b tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:01.284776 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd0b20ac-b3a5-4627-beca-6c3980985c5b tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:01.285466 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd0b20ac-b3a5-4627-beca-6c3980985c5b tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:01.286029 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd0b20ac-b3a5-4627-beca-6c3980985c5b tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:01.286482 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd0b20ac-b3a5-4627-beca-6c3980985c5b tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:01.296935 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3679cf30-5f83-4711-9968-b6b5c60ac54b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:01.297977 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3679cf30-5f83-4711-9968-b6b5c60ac54b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:01.303796 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3679cf30-5f83-4711-9968-b6b5c60ac54b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:01.304273 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3679cf30-5f83-4711-9968-b6b5c60ac54b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:01.304708 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3679cf30-5f83-4711-9968-b6b5c60ac54b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:01.305392 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3679cf30-5f83-4711-9968-b6b5c60ac54b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:01.305870 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3679cf30-5f83-4711-9968-b6b5c60ac54b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:01.308479 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3679cf30-5f83-4711-9968-b6b5c60ac54b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:01.474270 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-cd0b20ac-b3a5-4627-beca-6c3980985c5b tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:01.483141 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cd0b20ac-b3a5-4627-beca-6c3980985c5b tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1469 microversion: 2.1 time: 0.209836 Sep 04 16:16:01.498051 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 153/298] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:01 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1469 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:01.507428 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-3679cf30-5f83-4711-9968-b6b5c60ac54b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:01.516342 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3679cf30-5f83-4711-9968-b6b5c60ac54b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1509 microversion: 2.1 time: 0.223602 Sep 04 16:16:01.518908 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 146/299] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:01 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1509 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:02.167535 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d5cf190e-4e6b-493e-aa03-a8f939bcb06a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:02.168367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d5cf190e-4e6b-493e-aa03-a8f939bcb06a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:02.175606 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d5cf190e-4e6b-493e-aa03-a8f939bcb06a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:02.176178 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d5cf190e-4e6b-493e-aa03-a8f939bcb06a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:02.176682 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d5cf190e-4e6b-493e-aa03-a8f939bcb06a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:02.177439 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d5cf190e-4e6b-493e-aa03-a8f939bcb06a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:02.178004 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d5cf190e-4e6b-493e-aa03-a8f939bcb06a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:02.178446 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d5cf190e-4e6b-493e-aa03-a8f939bcb06a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:02.316514 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d5cf190e-4e6b-493e-aa03-a8f939bcb06a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:02.326640 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d5cf190e-4e6b-493e-aa03-a8f939bcb06a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:02.328882 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d5cf190e-4e6b-493e-aa03-a8f939bcb06a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:02.330124 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d5cf190e-4e6b-493e-aa03-a8f939bcb06a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1723 microversion: 2.20 time: 0.166651 Sep 04 16:16:02.331013 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 154/300] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:02 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:02.510618 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-78dda109-1504-4e9f-b0f7-bd80e9b7cd91 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:02.511138 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-78dda109-1504-4e9f-b0f7-bd80e9b7cd91 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:02.519056 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78dda109-1504-4e9f-b0f7-bd80e9b7cd91 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:02.519829 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78dda109-1504-4e9f-b0f7-bd80e9b7cd91 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:02.525557 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78dda109-1504-4e9f-b0f7-bd80e9b7cd91 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:02.525557 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78dda109-1504-4e9f-b0f7-bd80e9b7cd91 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:02.525557 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78dda109-1504-4e9f-b0f7-bd80e9b7cd91 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:02.525557 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-78dda109-1504-4e9f-b0f7-bd80e9b7cd91 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:02.540634 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f1deb19b-2a23-4a03-94d1-ac4ceffa0c00 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:02.541242 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f1deb19b-2a23-4a03-94d1-ac4ceffa0c00 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:02.547416 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1deb19b-2a23-4a03-94d1-ac4ceffa0c00 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:02.547958 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1deb19b-2a23-4a03-94d1-ac4ceffa0c00 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:02.548397 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1deb19b-2a23-4a03-94d1-ac4ceffa0c00 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:02.549108 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1deb19b-2a23-4a03-94d1-ac4ceffa0c00 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:02.549579 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1deb19b-2a23-4a03-94d1-ac4ceffa0c00 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:02.550056 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1deb19b-2a23-4a03-94d1-ac4ceffa0c00 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:02.770965 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-78dda109-1504-4e9f-b0f7-bd80e9b7cd91 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:02.774591 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f1deb19b-2a23-4a03-94d1-ac4ceffa0c00 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:02.779339 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-78dda109-1504-4e9f-b0f7-bd80e9b7cd91 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1469 microversion: 2.1 time: 0.272646 Sep 04 16:16:02.779906 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 147/301] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:02 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1469 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:02.783240 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f1deb19b-2a23-4a03-94d1-ac4ceffa0c00 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1509 microversion: 2.1 time: 0.246533 Sep 04 16:16:02.783808 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 155/302] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:02 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1509 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:03.363066 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-90c649d8-5289-4605-bfcd-2669ea8a2c96 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:03.363722 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-90c649d8-5289-4605-bfcd-2669ea8a2c96 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:03.369650 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90c649d8-5289-4605-bfcd-2669ea8a2c96 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:03.370129 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90c649d8-5289-4605-bfcd-2669ea8a2c96 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:03.370557 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90c649d8-5289-4605-bfcd-2669ea8a2c96 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:03.371239 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90c649d8-5289-4605-bfcd-2669ea8a2c96 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:03.371731 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90c649d8-5289-4605-bfcd-2669ea8a2c96 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:03.372149 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90c649d8-5289-4605-bfcd-2669ea8a2c96 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:03.517493 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-90c649d8-5289-4605-bfcd-2669ea8a2c96 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:03.526591 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-90c649d8-5289-4605-bfcd-2669ea8a2c96 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:03.528024 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-90c649d8-5289-4605-bfcd-2669ea8a2c96 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:03.532730 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-90c649d8-5289-4605-bfcd-2669ea8a2c96 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1723 microversion: 2.20 time: 0.170636 Sep 04 16:16:03.532730 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 148/303] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:03 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:03.806637 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9926d5a1-b7a4-4ed0-8185-a6880f5b35d5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:03.807240 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9926d5a1-b7a4-4ed0-8185-a6880f5b35d5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:03.814355 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9926d5a1-b7a4-4ed0-8185-a6880f5b35d5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:03.814843 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9926d5a1-b7a4-4ed0-8185-a6880f5b35d5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:03.815274 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9926d5a1-b7a4-4ed0-8185-a6880f5b35d5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:03.815969 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9926d5a1-b7a4-4ed0-8185-a6880f5b35d5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:03.816417 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9926d5a1-b7a4-4ed0-8185-a6880f5b35d5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:03.816838 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9926d5a1-b7a4-4ed0-8185-a6880f5b35d5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:03.817262 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a0e3c7c5-d515-479a-a43b-25a1582edcc4 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:03.817888 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a0e3c7c5-d515-479a-a43b-25a1582edcc4 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:03.823778 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0e3c7c5-d515-479a-a43b-25a1582edcc4 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:03.824250 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0e3c7c5-d515-479a-a43b-25a1582edcc4 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:03.824675 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0e3c7c5-d515-479a-a43b-25a1582edcc4 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:03.825530 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0e3c7c5-d515-479a-a43b-25a1582edcc4 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:03.826003 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0e3c7c5-d515-479a-a43b-25a1582edcc4 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:03.826420 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a0e3c7c5-d515-479a-a43b-25a1582edcc4 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:04.010715 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a0e3c7c5-d515-479a-a43b-25a1582edcc4 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:04.023960 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a0e3c7c5-d515-479a-a43b-25a1582edcc4 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1469 microversion: 2.1 time: 0.210368 Sep 04 16:16:04.024588 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 149/304] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:03 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1469 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:04.024800 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9926d5a1-b7a4-4ed0-8185-a6880f5b35d5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:04.035770 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9926d5a1-b7a4-4ed0-8185-a6880f5b35d5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1509 microversion: 2.1 time: 0.232852 Sep 04 16:16:04.036320 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 156/305] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:03 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1509 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:04.557519 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c7205dfa-d0af-4c2a-bd77-3157136af06e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:04.558136 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c7205dfa-d0af-4c2a-bd77-3157136af06e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:04.566146 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7205dfa-d0af-4c2a-bd77-3157136af06e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:04.566569 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7205dfa-d0af-4c2a-bd77-3157136af06e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:04.566999 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7205dfa-d0af-4c2a-bd77-3157136af06e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:04.567700 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7205dfa-d0af-4c2a-bd77-3157136af06e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:04.568155 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7205dfa-d0af-4c2a-bd77-3157136af06e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:04.568577 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c7205dfa-d0af-4c2a-bd77-3157136af06e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:04.704244 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c7205dfa-d0af-4c2a-bd77-3157136af06e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:04.712787 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c7205dfa-d0af-4c2a-bd77-3157136af06e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:04.714274 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c7205dfa-d0af-4c2a-bd77-3157136af06e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:04.715430 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c7205dfa-d0af-4c2a-bd77-3157136af06e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1723 microversion: 2.20 time: 0.162149 Sep 04 16:16:04.715972 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 150/306] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:04 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:05.048693 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-68de0a87-980e-4195-962d-aedd3b49bfaa tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:05.049292 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-68de0a87-980e-4195-962d-aedd3b49bfaa tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:05.056253 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-68de0a87-980e-4195-962d-aedd3b49bfaa tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:05.056762 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-68de0a87-980e-4195-962d-aedd3b49bfaa tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:05.057343 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-68de0a87-980e-4195-962d-aedd3b49bfaa tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:05.058555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-68de0a87-980e-4195-962d-aedd3b49bfaa tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:05.059358 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-68de0a87-980e-4195-962d-aedd3b49bfaa tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:05.059836 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-52da9dff-2f19-469f-b0b9-c05f8ab29623 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:05.060127 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-68de0a87-980e-4195-962d-aedd3b49bfaa tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:05.060448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-52da9dff-2f19-469f-b0b9-c05f8ab29623 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:05.067889 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52da9dff-2f19-469f-b0b9-c05f8ab29623 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:05.068457 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52da9dff-2f19-469f-b0b9-c05f8ab29623 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:05.068912 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52da9dff-2f19-469f-b0b9-c05f8ab29623 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:05.069650 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52da9dff-2f19-469f-b0b9-c05f8ab29623 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:05.070167 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52da9dff-2f19-469f-b0b9-c05f8ab29623 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:05.070631 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52da9dff-2f19-469f-b0b9-c05f8ab29623 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:05.255362 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-68de0a87-980e-4195-962d-aedd3b49bfaa tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:05.263425 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=12 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:16:05.263821 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-68de0a87-980e-4195-962d-aedd3b49bfaa tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1469 microversion: 2.1 time: 0.219055 Sep 04 16:16:05.264595 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 157/307] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:05 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1469 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:05.269625 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-52da9dff-2f19-469f-b0b9-c05f8ab29623 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:05.277236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-52da9dff-2f19-469f-b0b9-c05f8ab29623 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1509 microversion: 2.1 time: 0.221191 Sep 04 16:16:05.277906 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 151/308] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:05 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1509 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:05.741487 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b0a059a9-7760-4947-a45c-d14a01ae291b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:05.742176 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b0a059a9-7760-4947-a45c-d14a01ae291b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:05.748853 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0a059a9-7760-4947-a45c-d14a01ae291b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:05.749343 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0a059a9-7760-4947-a45c-d14a01ae291b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:05.749976 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0a059a9-7760-4947-a45c-d14a01ae291b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:05.750806 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0a059a9-7760-4947-a45c-d14a01ae291b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:05.751252 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0a059a9-7760-4947-a45c-d14a01ae291b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:05.751673 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0a059a9-7760-4947-a45c-d14a01ae291b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:05.885920 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b0a059a9-7760-4947-a45c-d14a01ae291b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:05.894385 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b0a059a9-7760-4947-a45c-d14a01ae291b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:05.895828 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b0a059a9-7760-4947-a45c-d14a01ae291b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:05.896957 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b0a059a9-7760-4947-a45c-d14a01ae291b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1723 microversion: 2.20 time: 0.159755 Sep 04 16:16:05.897510 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 158/309] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:05 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:06.288190 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e468c8c5-5169-499d-84a9-8a7eb5b334cc tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:06.288705 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e468c8c5-5169-499d-84a9-8a7eb5b334cc tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:06.295200 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e468c8c5-5169-499d-84a9-8a7eb5b334cc tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:06.295671 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e468c8c5-5169-499d-84a9-8a7eb5b334cc tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:06.296094 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e468c8c5-5169-499d-84a9-8a7eb5b334cc tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:06.297327 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e468c8c5-5169-499d-84a9-8a7eb5b334cc tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:06.297825 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e468c8c5-5169-499d-84a9-8a7eb5b334cc tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:06.298244 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e468c8c5-5169-499d-84a9-8a7eb5b334cc tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:06.301092 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-883ca21a-b1b2-49cf-964d-7d395b1a0c68 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:06.301749 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-883ca21a-b1b2-49cf-964d-7d395b1a0c68 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:06.307860 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-883ca21a-b1b2-49cf-964d-7d395b1a0c68 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:06.308383 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-883ca21a-b1b2-49cf-964d-7d395b1a0c68 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:06.308819 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-883ca21a-b1b2-49cf-964d-7d395b1a0c68 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:06.309509 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-883ca21a-b1b2-49cf-964d-7d395b1a0c68 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:06.309987 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-883ca21a-b1b2-49cf-964d-7d395b1a0c68 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:06.310411 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-883ca21a-b1b2-49cf-964d-7d395b1a0c68 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:06.502153 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e468c8c5-5169-499d-84a9-8a7eb5b334cc tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:06.509976 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e468c8c5-5169-499d-84a9-8a7eb5b334cc tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1469 microversion: 2.1 time: 0.226130 Sep 04 16:16:06.510550 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 152/310] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:06 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1469 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:06.513582 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-883ca21a-b1b2-49cf-964d-7d395b1a0c68 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:06.521725 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-883ca21a-b1b2-49cf-964d-7d395b1a0c68 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1509 microversion: 2.1 time: 0.225375 Sep 04 16:16:06.523446 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 159/311] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:06 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1509 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:06.923795 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7839d40c-a914-4811-a212-710f54d0245f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:06.924396 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7839d40c-a914-4811-a212-710f54d0245f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:06.930329 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7839d40c-a914-4811-a212-710f54d0245f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:06.930808 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7839d40c-a914-4811-a212-710f54d0245f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:06.931239 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7839d40c-a914-4811-a212-710f54d0245f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:06.931916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7839d40c-a914-4811-a212-710f54d0245f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:06.932374 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7839d40c-a914-4811-a212-710f54d0245f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:06.932794 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7839d40c-a914-4811-a212-710f54d0245f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:07.077277 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7839d40c-a914-4811-a212-710f54d0245f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:07.085922 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7839d40c-a914-4811-a212-710f54d0245f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:07.087355 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7839d40c-a914-4811-a212-710f54d0245f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:07.088501 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7839d40c-a914-4811-a212-710f54d0245f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1723 microversion: 2.20 time: 0.169000 Sep 04 16:16:07.089100 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 153/312] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:06 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:07.535079 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f2135de9-2590-450a-aef8-d16373981860 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:07.535680 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f2135de9-2590-450a-aef8-d16373981860 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:07.544907 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f2135de9-2590-450a-aef8-d16373981860 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:07.544907 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f2135de9-2590-450a-aef8-d16373981860 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:07.544907 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f2135de9-2590-450a-aef8-d16373981860 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:07.544907 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f2135de9-2590-450a-aef8-d16373981860 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:07.545612 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f2135de9-2590-450a-aef8-d16373981860 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:07.545612 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f2135de9-2590-450a-aef8-d16373981860 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:07.552451 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a54339e4-7758-4916-a33a-6396730b643c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:07.553475 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a54339e4-7758-4916-a33a-6396730b643c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:07.559804 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a54339e4-7758-4916-a33a-6396730b643c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:07.560283 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a54339e4-7758-4916-a33a-6396730b643c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:07.560723 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a54339e4-7758-4916-a33a-6396730b643c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:07.561418 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a54339e4-7758-4916-a33a-6396730b643c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:07.561903 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a54339e4-7758-4916-a33a-6396730b643c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:07.562918 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a54339e4-7758-4916-a33a-6396730b643c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:07.834598 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f2135de9-2590-450a-aef8-d16373981860 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:07.840751 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a54339e4-7758-4916-a33a-6396730b643c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:07.846731 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f2135de9-2590-450a-aef8-d16373981860 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1469 microversion: 2.1 time: 0.316645 Sep 04 16:16:07.847299 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 160/313] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:07 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1469 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:07.849420 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a54339e4-7758-4916-a33a-6396730b643c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1509 microversion: 2.1 time: 0.301391 Sep 04 16:16:07.850304 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 154/314] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:07 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1509 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:08.118227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ac552327-6862-450f-a873-7888100508f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:08.118745 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ac552327-6862-450f-a873-7888100508f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:08.124676 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ac552327-6862-450f-a873-7888100508f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:08.125267 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ac552327-6862-450f-a873-7888100508f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:08.125734 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ac552327-6862-450f-a873-7888100508f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:08.126416 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ac552327-6862-450f-a873-7888100508f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:08.126861 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ac552327-6862-450f-a873-7888100508f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:08.127277 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ac552327-6862-450f-a873-7888100508f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:08.262724 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ac552327-6862-450f-a873-7888100508f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:08.271219 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ac552327-6862-450f-a873-7888100508f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:08.272684 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ac552327-6862-450f-a873-7888100508f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:08.273906 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ac552327-6862-450f-a873-7888100508f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1723 microversion: 2.20 time: 0.159680 Sep 04 16:16:08.274469 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 161/315] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:08 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:08.871073 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3bbd6f54-6ade-4583-829e-f31999deec1e tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:08.871681 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3bbd6f54-6ade-4583-829e-f31999deec1e tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:08.876587 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-794dad20-94f6-4978-af5d-381ee8be661d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:08.877621 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-794dad20-94f6-4978-af5d-381ee8be661d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:08.878300 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3bbd6f54-6ade-4583-829e-f31999deec1e tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:08.878785 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3bbd6f54-6ade-4583-829e-f31999deec1e tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:08.879207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3bbd6f54-6ade-4583-829e-f31999deec1e tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:08.879894 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3bbd6f54-6ade-4583-829e-f31999deec1e tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:08.880350 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3bbd6f54-6ade-4583-829e-f31999deec1e tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:08.880763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3bbd6f54-6ade-4583-829e-f31999deec1e tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:08.883570 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-794dad20-94f6-4978-af5d-381ee8be661d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:08.884054 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-794dad20-94f6-4978-af5d-381ee8be661d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:08.884494 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-794dad20-94f6-4978-af5d-381ee8be661d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:08.885186 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-794dad20-94f6-4978-af5d-381ee8be661d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:08.885668 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-794dad20-94f6-4978-af5d-381ee8be661d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:08.886100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-794dad20-94f6-4978-af5d-381ee8be661d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:09.077399 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-3bbd6f54-6ade-4583-829e-f31999deec1e tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:09.081434 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-794dad20-94f6-4978-af5d-381ee8be661d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:09.086078 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3bbd6f54-6ade-4583-829e-f31999deec1e tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1469 microversion: 2.1 time: 0.218830 Sep 04 16:16:09.086666 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 155/316] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:08 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1469 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:09.089428 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-794dad20-94f6-4978-af5d-381ee8be661d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1509 microversion: 2.1 time: 0.216818 Sep 04 16:16:09.090034 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 162/317] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:08 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1509 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:09.300465 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9ad25b87-cc51-42e8-bec9-36c8ab9a3b94 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:09.300968 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9ad25b87-cc51-42e8-bec9-36c8ab9a3b94 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:09.307063 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ad25b87-cc51-42e8-bec9-36c8ab9a3b94 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:09.307748 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ad25b87-cc51-42e8-bec9-36c8ab9a3b94 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:09.308248 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ad25b87-cc51-42e8-bec9-36c8ab9a3b94 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:09.308928 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ad25b87-cc51-42e8-bec9-36c8ab9a3b94 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:09.309377 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ad25b87-cc51-42e8-bec9-36c8ab9a3b94 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:09.310188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9ad25b87-cc51-42e8-bec9-36c8ab9a3b94 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:09.332572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:16:09.448750 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-9ad25b87-cc51-42e8-bec9-36c8ab9a3b94 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:09.459020 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-9ad25b87-cc51-42e8-bec9-36c8ab9a3b94 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:09.460668 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-9ad25b87-cc51-42e8-bec9-36c8ab9a3b94 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:09.461965 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9ad25b87-cc51-42e8-bec9-36c8ab9a3b94 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1723 microversion: 2.20 time: 0.166091 Sep 04 16:16:09.462525 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 156/318] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:09 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:10.113483 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b714ac19-bc80-4f3f-95d9-7b8b2c408e2e tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:10.114299 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b714ac19-bc80-4f3f-95d9-7b8b2c408e2e tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:10.115188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ef691022-5d5c-4357-9278-4161a1ae07e0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:10.115798 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ef691022-5d5c-4357-9278-4161a1ae07e0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:10.120755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b714ac19-bc80-4f3f-95d9-7b8b2c408e2e tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:10.121240 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b714ac19-bc80-4f3f-95d9-7b8b2c408e2e tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:10.121716 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b714ac19-bc80-4f3f-95d9-7b8b2c408e2e tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:10.122414 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b714ac19-bc80-4f3f-95d9-7b8b2c408e2e tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:10.122866 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b714ac19-bc80-4f3f-95d9-7b8b2c408e2e tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:10.123286 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b714ac19-bc80-4f3f-95d9-7b8b2c408e2e tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:10.123390 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef691022-5d5c-4357-9278-4161a1ae07e0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:10.123880 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef691022-5d5c-4357-9278-4161a1ae07e0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:10.124320 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef691022-5d5c-4357-9278-4161a1ae07e0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:10.125009 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef691022-5d5c-4357-9278-4161a1ae07e0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:10.125466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef691022-5d5c-4357-9278-4161a1ae07e0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:10.125922 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef691022-5d5c-4357-9278-4161a1ae07e0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:10.322690 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ef691022-5d5c-4357-9278-4161a1ae07e0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:10.325727 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b714ac19-bc80-4f3f-95d9-7b8b2c408e2e tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:10.331575 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ef691022-5d5c-4357-9278-4161a1ae07e0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1509 microversion: 2.1 time: 0.220804 Sep 04 16:16:10.332273 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 157/319] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:10 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1509 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:10.335947 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b714ac19-bc80-4f3f-95d9-7b8b2c408e2e tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1469 microversion: 2.1 time: 0.227509 Sep 04 16:16:10.336611 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 163/320] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:10 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1469 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:10.489899 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b526d4f7-2ad2-411d-98af-aebc784eb526 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:10.490766 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b526d4f7-2ad2-411d-98af-aebc784eb526 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:10.497608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b526d4f7-2ad2-411d-98af-aebc784eb526 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:10.498103 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b526d4f7-2ad2-411d-98af-aebc784eb526 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:10.498539 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b526d4f7-2ad2-411d-98af-aebc784eb526 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:10.499234 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b526d4f7-2ad2-411d-98af-aebc784eb526 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:10.499685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b526d4f7-2ad2-411d-98af-aebc784eb526 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:10.500105 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b526d4f7-2ad2-411d-98af-aebc784eb526 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:10.640208 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b526d4f7-2ad2-411d-98af-aebc784eb526 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:10.654064 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b526d4f7-2ad2-411d-98af-aebc784eb526 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:10.655531 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b526d4f7-2ad2-411d-98af-aebc784eb526 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:10.658495 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b526d4f7-2ad2-411d-98af-aebc784eb526 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1723 microversion: 2.20 time: 0.172507 Sep 04 16:16:10.658495 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 158/321] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:10 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:11.356150 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-87f0620c-8450-4fba-86a7-10e9378a020c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:11.356790 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-87f0620c-8450-4fba-86a7-10e9378a020c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:11.360116 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6b64c683-3407-4fec-a588-439fb68794cc tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:11.360741 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6b64c683-3407-4fec-a588-439fb68794cc tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:11.363323 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-87f0620c-8450-4fba-86a7-10e9378a020c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:11.363797 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-87f0620c-8450-4fba-86a7-10e9378a020c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:11.364222 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-87f0620c-8450-4fba-86a7-10e9378a020c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:11.367384 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-87f0620c-8450-4fba-86a7-10e9378a020c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:11.367384 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-87f0620c-8450-4fba-86a7-10e9378a020c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:11.367384 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-87f0620c-8450-4fba-86a7-10e9378a020c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:11.367691 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b64c683-3407-4fec-a588-439fb68794cc tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:11.367933 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b64c683-3407-4fec-a588-439fb68794cc tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:11.368373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b64c683-3407-4fec-a588-439fb68794cc tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:11.369051 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b64c683-3407-4fec-a588-439fb68794cc tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:11.369503 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b64c683-3407-4fec-a588-439fb68794cc tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:11.369945 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6b64c683-3407-4fec-a588-439fb68794cc tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:11.566025 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-6b64c683-3407-4fec-a588-439fb68794cc tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:11.572895 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-87f0620c-8450-4fba-86a7-10e9378a020c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:11.573882 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6b64c683-3407-4fec-a588-439fb68794cc tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1469 microversion: 2.1 time: 0.217664 Sep 04 16:16:11.574454 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 159/322] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:11 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1469 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:11.582413 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-87f0620c-8450-4fba-86a7-10e9378a020c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1509 microversion: 2.1 time: 0.230466 Sep 04 16:16:11.582982 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 164/323] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:11 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1509 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:11.684022 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c0516242-e89f-4536-9265-1ce8df98401a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:11.684668 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c0516242-e89f-4536-9265-1ce8df98401a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:11.691238 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0516242-e89f-4536-9265-1ce8df98401a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:11.691712 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0516242-e89f-4536-9265-1ce8df98401a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:11.692138 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0516242-e89f-4536-9265-1ce8df98401a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:11.692808 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0516242-e89f-4536-9265-1ce8df98401a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:11.693258 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0516242-e89f-4536-9265-1ce8df98401a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:11.693712 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c0516242-e89f-4536-9265-1ce8df98401a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:11.820321 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c0516242-e89f-4536-9265-1ce8df98401a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:11.828186 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c0516242-e89f-4536-9265-1ce8df98401a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:11.830281 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c0516242-e89f-4536-9265-1ce8df98401a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:11.831443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c0516242-e89f-4536-9265-1ce8df98401a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1744 microversion: 2.20 time: 0.151594 Sep 04 16:16:11.831989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 160/324] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:11 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:12.597745 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0808f678-33cb-463e-bb98-25a3ade29cf3 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:12.598354 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0808f678-33cb-463e-bb98-25a3ade29cf3 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:12.604823 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0808f678-33cb-463e-bb98-25a3ade29cf3 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:12.605302 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0808f678-33cb-463e-bb98-25a3ade29cf3 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:12.605759 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0808f678-33cb-463e-bb98-25a3ade29cf3 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:12.606179 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d6390974-d9af-47d4-87b0-9c8c4679564b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:12.606597 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0808f678-33cb-463e-bb98-25a3ade29cf3 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:12.606883 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0808f678-33cb-463e-bb98-25a3ade29cf3 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:12.606983 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d6390974-d9af-47d4-87b0-9c8c4679564b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:12.607327 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0808f678-33cb-463e-bb98-25a3ade29cf3 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:12.613836 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6390974-d9af-47d4-87b0-9c8c4679564b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:12.614320 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6390974-d9af-47d4-87b0-9c8c4679564b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:12.614748 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6390974-d9af-47d4-87b0-9c8c4679564b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:12.615434 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6390974-d9af-47d4-87b0-9c8c4679564b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:12.615878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6390974-d9af-47d4-87b0-9c8c4679564b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:12.616346 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6390974-d9af-47d4-87b0-9c8c4679564b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:12.811025 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d6390974-d9af-47d4-87b0-9c8c4679564b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:12.813456 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0808f678-33cb-463e-bb98-25a3ade29cf3 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:12.822895 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d6390974-d9af-47d4-87b0-9c8c4679564b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1509 microversion: 2.1 time: 0.220449 Sep 04 16:16:12.823755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 161/325] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:12 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1509 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:12.824468 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0808f678-33cb-463e-bb98-25a3ade29cf3 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1469 microversion: 2.1 time: 0.231000 Sep 04 16:16:12.825222 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 165/326] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:12 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1469 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:12.856795 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-de64687e-f2aa-4910-b883-65891655ce05 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:12.857311 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-de64687e-f2aa-4910-b883-65891655ce05 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:12.863846 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de64687e-f2aa-4910-b883-65891655ce05 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:12.864316 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de64687e-f2aa-4910-b883-65891655ce05 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:12.864737 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de64687e-f2aa-4910-b883-65891655ce05 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:12.865433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de64687e-f2aa-4910-b883-65891655ce05 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:12.865907 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de64687e-f2aa-4910-b883-65891655ce05 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:12.866319 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-de64687e-f2aa-4910-b883-65891655ce05 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:13.000319 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-de64687e-f2aa-4910-b883-65891655ce05 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:13.009117 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-de64687e-f2aa-4910-b883-65891655ce05 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:13.010592 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-de64687e-f2aa-4910-b883-65891655ce05 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:13.011848 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-de64687e-f2aa-4910-b883-65891655ce05 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1744 microversion: 2.20 time: 0.159280 Sep 04 16:16:13.012591 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 162/327] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:12 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:13.846899 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4649463d-4930-49da-b4c5-7b272401a71a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:13.847576 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4649463d-4930-49da-b4c5-7b272401a71a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:13.848199 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f05dad98-b232-45b5-b871-540d2d0810ad tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:13.848819 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f05dad98-b232-45b5-b871-540d2d0810ad tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:13.854100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4649463d-4930-49da-b4c5-7b272401a71a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:13.854581 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4649463d-4930-49da-b4c5-7b272401a71a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:13.855016 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4649463d-4930-49da-b4c5-7b272401a71a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:13.855154 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f05dad98-b232-45b5-b871-540d2d0810ad tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:13.855638 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f05dad98-b232-45b5-b871-540d2d0810ad tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:13.855733 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4649463d-4930-49da-b4c5-7b272401a71a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:13.856079 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f05dad98-b232-45b5-b871-540d2d0810ad tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:13.856199 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4649463d-4930-49da-b4c5-7b272401a71a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:13.856557 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4649463d-4930-49da-b4c5-7b272401a71a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:13.856764 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f05dad98-b232-45b5-b871-540d2d0810ad tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:13.857220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f05dad98-b232-45b5-b871-540d2d0810ad tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:13.857670 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f05dad98-b232-45b5-b871-540d2d0810ad tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:14.045725 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4649463d-4930-49da-b4c5-7b272401a71a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:14.058532 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f05dad98-b232-45b5-b871-540d2d0810ad tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:14.058695 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4649463d-4930-49da-b4c5-7b272401a71a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1509 microversion: 2.1 time: 0.211242 Sep 04 16:16:14.058695 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 166/328] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:13 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1509 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:14.059270 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a33e0cb5-b754-42a2-a0cb-d97a42eada30 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:14.059913 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a33e0cb5-b754-42a2-a0cb-d97a42eada30 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:14.061442 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f05dad98-b232-45b5-b871-540d2d0810ad tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1469 microversion: 2.1 time: 0.216961 Sep 04 16:16:14.062118 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 163/329] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:13 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1469 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:14.065973 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a33e0cb5-b754-42a2-a0cb-d97a42eada30 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:14.066463 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a33e0cb5-b754-42a2-a0cb-d97a42eada30 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:14.066893 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a33e0cb5-b754-42a2-a0cb-d97a42eada30 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:14.067587 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a33e0cb5-b754-42a2-a0cb-d97a42eada30 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:14.068101 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a33e0cb5-b754-42a2-a0cb-d97a42eada30 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:14.068528 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a33e0cb5-b754-42a2-a0cb-d97a42eada30 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:14.087456 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:16:14.200633 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a33e0cb5-b754-42a2-a0cb-d97a42eada30 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:14.208862 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a33e0cb5-b754-42a2-a0cb-d97a42eada30 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:14.210399 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a33e0cb5-b754-42a2-a0cb-d97a42eada30 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:14.211584 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a33e0cb5-b754-42a2-a0cb-d97a42eada30 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1744 microversion: 2.20 time: 0.155970 Sep 04 16:16:14.212138 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 167/330] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:14 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:14.356802 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-f90793a1-b089-45dd-b7d0-31ca1d9dcfb7 req-c3b7e1e7-44a2-4162-ab23-c6c03b1e7ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d92778a-fe09-4720-8b6c-a9f5a7aea57f", "name": "network-vif-unplugged", "status": "completed", "tag": "af83fee5-86b0-448e-964a-b5a1fb38dc23"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:16:14.366912 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f90793a1-b089-45dd-b7d0-31ca1d9dcfb7 req-c3b7e1e7-44a2-4162-ab23-c6c03b1e7ac6 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:14.367380 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f90793a1-b089-45dd-b7d0-31ca1d9dcfb7 req-c3b7e1e7-44a2-4162-ab23-c6c03b1e7ac6 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:14.367799 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f90793a1-b089-45dd-b7d0-31ca1d9dcfb7 req-c3b7e1e7-44a2-4162-ab23-c6c03b1e7ac6 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:14.379690 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-f90793a1-b089-45dd-b7d0-31ca1d9dcfb7 req-c3b7e1e7-44a2-4162-ab23-c6c03b1e7ac6 service nova] Creating event network-vif-unplugged:af83fee5-86b0-448e-964a-b5a1fb38dc23 for instance 4d92778a-fe09-4720-8b6c-a9f5a7aea57f on hv-cinder-85236 Sep 04 16:16:14.384844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-f90793a1-b089-45dd-b7d0-31ca1d9dcfb7 req-c3b7e1e7-44a2-4162-ab23-c6c03b1e7ac6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031682 Sep 04 16:16:14.385419 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 164/331] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:16:14.981688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-c0c9bac7-78bc-4141-a377-ef3a360e41e2 req-2ebb7068-194c-4457-adf3-98f24773e73b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d92778a-fe09-4720-8b6c-a9f5a7aea57f", "name": "network-vif-deleted", "tag": "af83fee5-86b0-448e-964a-b5a1fb38dc23"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:16:14.992904 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-c0c9bac7-78bc-4141-a377-ef3a360e41e2 req-2ebb7068-194c-4457-adf3-98f24773e73b service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:14.993472 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-c0c9bac7-78bc-4141-a377-ef3a360e41e2 req-2ebb7068-194c-4457-adf3-98f24773e73b service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:14.993995 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-c0c9bac7-78bc-4141-a377-ef3a360e41e2 req-2ebb7068-194c-4457-adf3-98f24773e73b service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:15.006293 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-c0c9bac7-78bc-4141-a377-ef3a360e41e2 req-2ebb7068-194c-4457-adf3-98f24773e73b service nova] Creating event network-vif-deleted:af83fee5-86b0-448e-964a-b5a1fb38dc23 for instance 4d92778a-fe09-4720-8b6c-a9f5a7aea57f on hv-cinder-85236 Sep 04 16:16:15.011247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-c0c9bac7-78bc-4141-a377-ef3a360e41e2 req-2ebb7068-194c-4457-adf3-98f24773e73b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033281 Sep 04 16:16:15.011927 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 168/332] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:16:15.081752 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-02df688a-378d-4336-9b40-c0d4b1e0f9df tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:15.083229 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-02df688a-378d-4336-9b40-c0d4b1e0f9df tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:15.086662 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4e7dcfaf-0749-4a6e-be61-ca8493c221f8 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:15.087685 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4e7dcfaf-0749-4a6e-be61-ca8493c221f8 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:15.090466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02df688a-378d-4336-9b40-c0d4b1e0f9df tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:15.091105 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02df688a-378d-4336-9b40-c0d4b1e0f9df tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:15.092185 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02df688a-378d-4336-9b40-c0d4b1e0f9df tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:15.093409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02df688a-378d-4336-9b40-c0d4b1e0f9df tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:15.094289 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4e7dcfaf-0749-4a6e-be61-ca8493c221f8 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:15.094606 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02df688a-378d-4336-9b40-c0d4b1e0f9df tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:15.094770 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4e7dcfaf-0749-4a6e-be61-ca8493c221f8 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:15.095073 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02df688a-378d-4336-9b40-c0d4b1e0f9df tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:15.095999 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4e7dcfaf-0749-4a6e-be61-ca8493c221f8 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:15.096974 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4e7dcfaf-0749-4a6e-be61-ca8493c221f8 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:15.097424 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4e7dcfaf-0749-4a6e-be61-ca8493c221f8 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:15.098009 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4e7dcfaf-0749-4a6e-be61-ca8493c221f8 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:15.187152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4e7dcfaf-0749-4a6e-be61-ca8493c221f8 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:15.195153 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4e7dcfaf-0749-4a6e-be61-ca8493c221f8 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1427 microversion: 2.1 time: 0.112845 Sep 04 16:16:15.195873 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 169/333] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:15 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1427 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:15.237862 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-761305aa-8594-4833-8744-6dc37d2650c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:15.238564 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-761305aa-8594-4833-8744-6dc37d2650c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:15.244938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-761305aa-8594-4833-8744-6dc37d2650c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:15.245418 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-761305aa-8594-4833-8744-6dc37d2650c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:15.245872 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-761305aa-8594-4833-8744-6dc37d2650c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:15.246564 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-761305aa-8594-4833-8744-6dc37d2650c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:15.247008 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-761305aa-8594-4833-8744-6dc37d2650c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:15.247422 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-761305aa-8594-4833-8744-6dc37d2650c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:15.522593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-02df688a-378d-4336-9b40-c0d4b1e0f9df tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:15.530326 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-02df688a-378d-4336-9b40-c0d4b1e0f9df tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1509 microversion: 2.1 time: 0.453761 Sep 04 16:16:15.530891 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 165/334] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:15 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1509 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:15.620828 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-761305aa-8594-4833-8744-6dc37d2650c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:15.630304 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-761305aa-8594-4833-8744-6dc37d2650c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:15.631742 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-761305aa-8594-4833-8744-6dc37d2650c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:15.632886 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-761305aa-8594-4833-8744-6dc37d2650c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1744 microversion: 2.20 time: 0.399234 Sep 04 16:16:15.633441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 170/335] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:15 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1744 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:16:16.218736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ddc20901-12f6-49d1-b53e-e81779c019f4 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:16.219337 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ddc20901-12f6-49d1-b53e-e81779c019f4 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:16.226359 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddc20901-12f6-49d1-b53e-e81779c019f4 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:16.226831 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddc20901-12f6-49d1-b53e-e81779c019f4 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:16.227254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddc20901-12f6-49d1-b53e-e81779c019f4 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:16.227926 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddc20901-12f6-49d1-b53e-e81779c019f4 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:16.228368 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddc20901-12f6-49d1-b53e-e81779c019f4 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:16.228811 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ddc20901-12f6-49d1-b53e-e81779c019f4 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:16.292763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ddc20901-12f6-49d1-b53e-e81779c019f4 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:16.301183 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ddc20901-12f6-49d1-b53e-e81779c019f4 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1427 microversion: 2.1 time: 0.086351 Sep 04 16:16:16.301770 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 166/336] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:16 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:16.553624 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7024d202-5ca0-4a98-8f1a-7630105d7a33 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:16.554259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7024d202-5ca0-4a98-8f1a-7630105d7a33 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:16.556775 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=78 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:16:16.561946 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7024d202-5ca0-4a98-8f1a-7630105d7a33 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:16.562432 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7024d202-5ca0-4a98-8f1a-7630105d7a33 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:16.562866 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7024d202-5ca0-4a98-8f1a-7630105d7a33 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:16.563606 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7024d202-5ca0-4a98-8f1a-7630105d7a33 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:16.564348 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7024d202-5ca0-4a98-8f1a-7630105d7a33 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:16.564773 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7024d202-5ca0-4a98-8f1a-7630105d7a33 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:16.659563 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-df401143-b446-4300-96fd-ea78da81da36 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:16.660159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-df401143-b446-4300-96fd-ea78da81da36 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:16.666033 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df401143-b446-4300-96fd-ea78da81da36 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:16.666510 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df401143-b446-4300-96fd-ea78da81da36 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:16.666933 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df401143-b446-4300-96fd-ea78da81da36 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:16.667615 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df401143-b446-4300-96fd-ea78da81da36 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:16.668061 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df401143-b446-4300-96fd-ea78da81da36 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:16.668477 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-df401143-b446-4300-96fd-ea78da81da36 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:16.692832 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7024d202-5ca0-4a98-8f1a-7630105d7a33 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:16.700534 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7024d202-5ca0-4a98-8f1a-7630105d7a33 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1509 microversion: 2.1 time: 0.150858 Sep 04 16:16:16.701097 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 171/337] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:16 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:16.798336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-df401143-b446-4300-96fd-ea78da81da36 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:16.807169 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-df401143-b446-4300-96fd-ea78da81da36 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:16.808609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-df401143-b446-4300-96fd-ea78da81da36 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:16.809794 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-df401143-b446-4300-96fd-ea78da81da36 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1744 microversion: 2.20 time: 0.154699 Sep 04 16:16:16.810542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 167/338] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:16 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:16:17.324257 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6c7cb9bb-7758-4105-bdea-c359bc6d0b4c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:17.324860 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6c7cb9bb-7758-4105-bdea-c359bc6d0b4c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:17.331026 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6c7cb9bb-7758-4105-bdea-c359bc6d0b4c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:17.331508 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6c7cb9bb-7758-4105-bdea-c359bc6d0b4c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:17.331945 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6c7cb9bb-7758-4105-bdea-c359bc6d0b4c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:17.332631 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6c7cb9bb-7758-4105-bdea-c359bc6d0b4c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:17.333090 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6c7cb9bb-7758-4105-bdea-c359bc6d0b4c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:17.333508 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6c7cb9bb-7758-4105-bdea-c359bc6d0b4c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:17.399057 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6c7cb9bb-7758-4105-bdea-c359bc6d0b4c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:17.408546 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6c7cb9bb-7758-4105-bdea-c359bc6d0b4c tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1427 microversion: 2.1 time: 0.088072 Sep 04 16:16:17.409326 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 172/339] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:17 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1427 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:17.726267 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c77d045b-e47d-49e4-a6e2-0c564385984f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:17.726874 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c77d045b-e47d-49e4-a6e2-0c564385984f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:17.734054 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c77d045b-e47d-49e4-a6e2-0c564385984f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:17.734710 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c77d045b-e47d-49e4-a6e2-0c564385984f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:17.735394 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c77d045b-e47d-49e4-a6e2-0c564385984f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:17.736097 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c77d045b-e47d-49e4-a6e2-0c564385984f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:17.737768 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c77d045b-e47d-49e4-a6e2-0c564385984f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:17.738240 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c77d045b-e47d-49e4-a6e2-0c564385984f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:17.837641 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4b4e3008-e0d6-4adb-bf5b-3e1ab1cc290e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:17.838255 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4b4e3008-e0d6-4adb-bf5b-3e1ab1cc290e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:17.848461 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4b4e3008-e0d6-4adb-bf5b-3e1ab1cc290e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:17.849136 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4b4e3008-e0d6-4adb-bf5b-3e1ab1cc290e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:17.849792 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4b4e3008-e0d6-4adb-bf5b-3e1ab1cc290e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:17.850493 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4b4e3008-e0d6-4adb-bf5b-3e1ab1cc290e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:17.850952 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4b4e3008-e0d6-4adb-bf5b-3e1ab1cc290e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:17.851372 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4b4e3008-e0d6-4adb-bf5b-3e1ab1cc290e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:17.935968 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c77d045b-e47d-49e4-a6e2-0c564385984f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:17.949776 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c77d045b-e47d-49e4-a6e2-0c564385984f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1509 microversion: 2.1 time: 0.228441 Sep 04 16:16:17.951132 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 168/340] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:17 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1509 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:18.068544 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4b4e3008-e0d6-4adb-bf5b-3e1ab1cc290e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:18.078486 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4b4e3008-e0d6-4adb-bf5b-3e1ab1cc290e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:18.080560 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4b4e3008-e0d6-4adb-bf5b-3e1ab1cc290e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:18.081810 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4b4e3008-e0d6-4adb-bf5b-3e1ab1cc290e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1744 microversion: 2.20 time: 0.248819 Sep 04 16:16:18.083070 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 173/341] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:17 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1744 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:18.380504 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5ae476e4-4581-4c51-a1e7-298b3cb62c0c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Action: 'create', calling method: .version_select at 0x7f968954c280>, body: {"keypair": {"name": "tempest-keypair-1105122954", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+/CdIM/m1s/NrVUtEuW889tST3xDGXhTBopRUtdUG6iLDX3VcP9eXon5xs21KgPRdH9lPpfYFBvwl/uBpYAwXOdf8cJMK60eb4Hqz1xZl/I1Q2y4rcTdyLPC+bkZxpvw=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:16:18.399295 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-5ae476e4-4581-4c51-a1e7-298b3cb62c0c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Getting quotas for project 1cc5ea4158344d5c8a35bc5783410620. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:16:18.403954 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-5ae476e4-4581-4c51-a1e7-298b3cb62c0c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Getting quotas for user 6e5c22b631df4600b9f920120b67fc67 and project 1cc5ea4158344d5c8a35bc5783410620. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:16:18.423223 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:16:18.441099 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-66386595-69eb-47a3-9eb6-15175e997c83 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:18.442286 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-66386595-69eb-47a3-9eb6-15175e997c83 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:18.451813 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66386595-69eb-47a3-9eb6-15175e997c83 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:18.452592 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66386595-69eb-47a3-9eb6-15175e997c83 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:18.453302 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66386595-69eb-47a3-9eb6-15175e997c83 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:18.454635 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66386595-69eb-47a3-9eb6-15175e997c83 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:18.457384 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66386595-69eb-47a3-9eb6-15175e997c83 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:18.458317 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66386595-69eb-47a3-9eb6-15175e997c83 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:18.637707 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66386595-69eb-47a3-9eb6-15175e997c83 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:18.637707 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66386595-69eb-47a3-9eb6-15175e997c83 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:18.637707 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66386595-69eb-47a3-9eb6-15175e997c83 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:18.637707 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-66386595-69eb-47a3-9eb6-15175e997c83 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lazy-loading 'fault' on Instance uuid 4d92778a-fe09-4720-8b6c-a9f5a7aea57f {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:16:18.638518 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-66386595-69eb-47a3-9eb6-15175e997c83 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:18.638518 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-66386595-69eb-47a3-9eb6-15175e997c83 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1304 microversion: 2.1 time: 0.124484 Sep 04 16:16:18.638518 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 174/342] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:18 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:18.955149 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5ae476e4-4581-4c51-a1e7-298b3cb62c0c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.579963 Sep 04 16:16:18.956419 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 169/343] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Sep 4 16:16:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:16:18.979256 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e4a305cb-4f83-4084-932c-67b80633bda7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:18.980090 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e4a305cb-4f83-4084-932c-67b80633bda7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:18.987636 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e4a305cb-4f83-4084-932c-67b80633bda7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:18.988306 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e4a305cb-4f83-4084-932c-67b80633bda7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:18.988909 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e4a305cb-4f83-4084-932c-67b80633bda7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:18.989845 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e4a305cb-4f83-4084-932c-67b80633bda7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:18.990467 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e4a305cb-4f83-4084-932c-67b80633bda7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:18.990860 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e4a305cb-4f83-4084-932c-67b80633bda7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:19.110273 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f18e41f2-57ed-4672-986d-a6d16328f7d0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:19.110900 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f18e41f2-57ed-4672-986d-a6d16328f7d0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:19.119079 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f18e41f2-57ed-4672-986d-a6d16328f7d0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:19.119628 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f18e41f2-57ed-4672-986d-a6d16328f7d0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:19.120062 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f18e41f2-57ed-4672-986d-a6d16328f7d0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:19.120754 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f18e41f2-57ed-4672-986d-a6d16328f7d0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:19.121205 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f18e41f2-57ed-4672-986d-a6d16328f7d0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:19.121644 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f18e41f2-57ed-4672-986d-a6d16328f7d0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:19.148887 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e4a305cb-4f83-4084-932c-67b80633bda7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:19.157550 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e4a305cb-4f83-4084-932c-67b80633bda7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1509 microversion: 2.1 time: 0.183794 Sep 04 16:16:19.158235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 175/344] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:18 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1509 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:19.281042 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f18e41f2-57ed-4672-986d-a6d16328f7d0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:19.290498 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f18e41f2-57ed-4672-986d-a6d16328f7d0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:19.291989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f18e41f2-57ed-4672-986d-a6d16328f7d0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:19.293152 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f18e41f2-57ed-4672-986d-a6d16328f7d0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1744 microversion: 2.20 time: 0.188428 Sep 04 16:16:19.293733 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 170/345] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:19 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1744 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:16:19.645306 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f03953d4-ba40-4df5-83d9-09ecc599850d tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:19.646084 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f03953d4-ba40-4df5-83d9-09ecc599850d tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:19.653656 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f03953d4-ba40-4df5-83d9-09ecc599850d tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:19.654354 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f03953d4-ba40-4df5-83d9-09ecc599850d tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:19.654785 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f03953d4-ba40-4df5-83d9-09ecc599850d tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:19.655485 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f03953d4-ba40-4df5-83d9-09ecc599850d tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:19.655940 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f03953d4-ba40-4df5-83d9-09ecc599850d tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:19.657027 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f03953d4-ba40-4df5-83d9-09ecc599850d tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:19.696448 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f03953d4-ba40-4df5-83d9-09ecc599850d tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:19.696928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f03953d4-ba40-4df5-83d9-09ecc599850d tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:19.697370 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f03953d4-ba40-4df5-83d9-09ecc599850d tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:19.697835 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-f03953d4-ba40-4df5-83d9-09ecc599850d tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lazy-loading 'fault' on Instance uuid 4d92778a-fe09-4720-8b6c-a9f5a7aea57f {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:16:19.749601 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f03953d4-ba40-4df5-83d9-09ecc599850d tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:19.757804 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f03953d4-ba40-4df5-83d9-09ecc599850d tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1304 microversion: 2.1 time: 0.116987 Sep 04 16:16:19.758509 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 176/346] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:19 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:19.902417 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-e14287df-bef3-461c-9571-2de8d1791bd2 req-6feaef88-6096-415c-ae76-b256927ce1ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25192300-f22a-4b50-b390-17236f961eb5", "name": "network-vif-plugged", "status": "completed", "tag": "ea45359b-6df0-4bcb-9182-26e4cca9bdd6"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:16:19.914271 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e14287df-bef3-461c-9571-2de8d1791bd2 req-6feaef88-6096-415c-ae76-b256927ce1ae service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:19.915879 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e14287df-bef3-461c-9571-2de8d1791bd2 req-6feaef88-6096-415c-ae76-b256927ce1ae service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:19.916718 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e14287df-bef3-461c-9571-2de8d1791bd2 req-6feaef88-6096-415c-ae76-b256927ce1ae service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:19.942381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-e14287df-bef3-461c-9571-2de8d1791bd2 req-6feaef88-6096-415c-ae76-b256927ce1ae service nova] Creating event network-vif-plugged:ea45359b-6df0-4bcb-9182-26e4cca9bdd6 for instance 25192300-f22a-4b50-b390-17236f961eb5 on hv-cinder-85236 Sep 04 16:16:19.947566 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-e14287df-bef3-461c-9571-2de8d1791bd2 req-6feaef88-6096-415c-ae76-b256927ce1ae service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048890 Sep 04 16:16:19.951895 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 171/347] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:16:20.182474 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-06113194-4306-4113-9c1b-4abd3fb3150a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:20.183282 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-06113194-4306-4113-9c1b-4abd3fb3150a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:20.189131 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-06113194-4306-4113-9c1b-4abd3fb3150a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:20.189698 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-06113194-4306-4113-9c1b-4abd3fb3150a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:20.190751 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-06113194-4306-4113-9c1b-4abd3fb3150a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:20.191447 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-06113194-4306-4113-9c1b-4abd3fb3150a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:20.191901 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-06113194-4306-4113-9c1b-4abd3fb3150a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:20.192328 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-06113194-4306-4113-9c1b-4abd3fb3150a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:20.319631 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-08815b45-b424-4d56-99fa-59d92840ff12 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:20.320402 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-08815b45-b424-4d56-99fa-59d92840ff12 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:20.328077 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08815b45-b424-4d56-99fa-59d92840ff12 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:20.328582 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08815b45-b424-4d56-99fa-59d92840ff12 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:20.329669 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08815b45-b424-4d56-99fa-59d92840ff12 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:20.331259 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08815b45-b424-4d56-99fa-59d92840ff12 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:20.331895 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08815b45-b424-4d56-99fa-59d92840ff12 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:20.332490 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-08815b45-b424-4d56-99fa-59d92840ff12 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:20.445439 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-06113194-4306-4113-9c1b-4abd3fb3150a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:20.453323 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-06113194-4306-4113-9c1b-4abd3fb3150a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1509 microversion: 2.1 time: 0.275488 Sep 04 16:16:20.454129 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 177/348] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:20 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1509 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:20.569414 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-08815b45-b424-4d56-99fa-59d92840ff12 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:20.583304 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-08815b45-b424-4d56-99fa-59d92840ff12 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:20.583750 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-08815b45-b424-4d56-99fa-59d92840ff12 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:20.584979 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-08815b45-b424-4d56-99fa-59d92840ff12 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1744 microversion: 2.20 time: 0.270751 Sep 04 16:16:20.585745 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 172/349] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:20 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1744 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:16:20.783020 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-724ca93b-581e-4bd6-bfe2-66f356509a94 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:20.783632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-724ca93b-581e-4bd6-bfe2-66f356509a94 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:20.790665 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-724ca93b-581e-4bd6-bfe2-66f356509a94 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:20.791151 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-724ca93b-581e-4bd6-bfe2-66f356509a94 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:20.791587 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-724ca93b-581e-4bd6-bfe2-66f356509a94 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:20.792277 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-724ca93b-581e-4bd6-bfe2-66f356509a94 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:20.792726 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-724ca93b-581e-4bd6-bfe2-66f356509a94 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:20.793148 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-724ca93b-581e-4bd6-bfe2-66f356509a94 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:20.829193 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-724ca93b-581e-4bd6-bfe2-66f356509a94 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:20.829794 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-724ca93b-581e-4bd6-bfe2-66f356509a94 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:20.830227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-724ca93b-581e-4bd6-bfe2-66f356509a94 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:20.831686 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-724ca93b-581e-4bd6-bfe2-66f356509a94 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lazy-loading 'fault' on Instance uuid 4d92778a-fe09-4720-8b6c-a9f5a7aea57f {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:16:20.897963 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-724ca93b-581e-4bd6-bfe2-66f356509a94 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c835608161474af8a96909d20bc9c94d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0323333989a4014a3be79e8349e1840', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:20.905841 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-724ca93b-581e-4bd6-bfe2-66f356509a94 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 200 len: 1304 microversion: 2.1 time: 0.126846 Sep 04 16:16:20.906416 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 178/350] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:20 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 1304 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:21.480885 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d7623dc8-a1bf-4353-80fe-0c58e5727806 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:21.482544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d7623dc8-a1bf-4353-80fe-0c58e5727806 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:21.494075 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7623dc8-a1bf-4353-80fe-0c58e5727806 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:21.494702 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7623dc8-a1bf-4353-80fe-0c58e5727806 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:21.495296 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7623dc8-a1bf-4353-80fe-0c58e5727806 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:21.496064 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7623dc8-a1bf-4353-80fe-0c58e5727806 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:21.496606 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7623dc8-a1bf-4353-80fe-0c58e5727806 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:21.497348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d7623dc8-a1bf-4353-80fe-0c58e5727806 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:21.580062 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a6dbf374-443a-43b1-aa6b-84d6ad052327 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1958071906", "imageRef": "11a460f6-29b0-46e6-ae98-e53ee2e13520", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1fe4af06-d7bb-4218-9bf8-f19072fe6b17"}], "security_groups": [{"name": "tempest-securitygroup--1069246550"}], "key_name": "tempest-keypair-1105122954", "user_data": "}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:16:21.646418 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d7623dc8-a1bf-4353-80fe-0c58e5727806 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:21.654299 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d7623dc8-a1bf-4353-80fe-0c58e5727806 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1515 microversion: 2.1 time: 0.179347 Sep 04 16:16:21.657708 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 173/351] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:21 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:21.661365 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-90098d71-d534-4d2b-92a1-0601ac9675f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:21.662194 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-90098d71-d534-4d2b-92a1-0601ac9675f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:21.668111 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90098d71-d534-4d2b-92a1-0601ac9675f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:21.668596 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90098d71-d534-4d2b-92a1-0601ac9675f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:21.669033 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90098d71-d534-4d2b-92a1-0601ac9675f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:21.669757 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90098d71-d534-4d2b-92a1-0601ac9675f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:21.670212 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90098d71-d534-4d2b-92a1-0601ac9675f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:21.670631 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90098d71-d534-4d2b-92a1-0601ac9675f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:21.835512 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-a6dbf374-443a-43b1-aa6b-84d6ad052327 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] validate_networks() for [('1fe4af06-d7bb-4218-9bf8-f19072fe6b17', None, None, None, None, None)] {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 16:16:21.883314 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-90098d71-d534-4d2b-92a1-0601ac9675f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:21.896413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-90098d71-d534-4d2b-92a1-0601ac9675f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:21.905146 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-90098d71-d534-4d2b-92a1-0601ac9675f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:21.906548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-90098d71-d534-4d2b-92a1-0601ac9675f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1739 microversion: 2.20 time: 0.250421 Sep 04 16:16:21.907141 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 174/352] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:21 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1739 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:21.933031 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-40a62417-7559-40c6-a218-7e710ce9fbb6 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:21.933031 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-40a62417-7559-40c6-a218-7e710ce9fbb6 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] [instance: 4d92778a-fe09-4720-8b6c-a9f5a7aea57f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:21.937497 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40a62417-7559-40c6-a218-7e710ce9fbb6 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:21.938004 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40a62417-7559-40c6-a218-7e710ce9fbb6 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:21.938437 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40a62417-7559-40c6-a218-7e710ce9fbb6 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:21.939134 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40a62417-7559-40c6-a218-7e710ce9fbb6 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:21.939609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40a62417-7559-40c6-a218-7e710ce9fbb6 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:21.940654 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40a62417-7559-40c6-a218-7e710ce9fbb6 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:21.966653 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-40a62417-7559-40c6-a218-7e710ce9fbb6 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] HTTP exception thrown: Instance 4d92778a-fe09-4720-8b6c-a9f5a7aea57f could not be found. Sep 04 16:16:21.968448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-40a62417-7559-40c6-a218-7e710ce9fbb6 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Request method failure captured: Sep 04 16:16:21.968448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f HTTP/1.1 Sep 04 16:16:21.968448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:16:21.968448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:16:21.968448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:16:21.968448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 04 16:16:21.968448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:16:21.968448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:16:21.968448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:16:21.968448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:16:21.968448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFM8jC2HUKDSn_3DYOpZbBE0Mcs8ZxauOHlc5Ba9zhkhHDybDyRztV501Xc-auPGZu1EwZwhU1nW6Tq35UdL7GtFRL6s9pVQjtfwogK-hRvXzO-jAjjQlHp_krP180ouaq4i01MNeSrvELE_Dd2Tx0VE9KdpA5YYjTnh7waj9aeNv0gw Sep 04 16:16:21.968448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:16:21.968448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:16:21.968448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:16:21.968448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:16:21.968448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:16:21.968448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:16:21.968448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: f0323333989a4014a3be79e8349e1840 Sep 04 16:16:21.968448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-VolumesNegativeTest-1974394696 Sep 04 16:16:21.968448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:16:21.968448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:16:21.970071 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f0323333989a4014a3be79e8349e1840"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f0323333989a4014a3be79e8349e1840"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f0323333989a4014a3be79e8349e1840", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f0323333989a4014a3be79e8349e1840"}]}] Sep 04 16:16:21.970071 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-VolumesNegativeTest-1974394696 Sep 04 16:16:21.970071 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: f0323333989a4014a3be79e8349e1840 Sep 04 16:16:21.970071 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-VolumesNegativeTest-1974394696 Sep 04 16:16:21.970071 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-VolumesNegativeTest-1974394696-project Sep 04 16:16:21.970071 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:16:21.970071 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:16:21.970071 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: c835608161474af8a96909d20bc9c94d Sep 04 16:16:21.970071 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-VolumesNegativeTest-1974394696-project Sep 04 16:16:21.970071 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: > Sep 04 16:16:21.970071 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Instance 4d92778a-fe09-4720-8b6c-a9f5a7aea57f could not be found. Sep 04 16:16:21.970071 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'id': '4d92778a-fe09-4720-8b6c-a9f5a7aea57f'} Sep 04 16:16:21.971043 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:16:21.971043 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:16:21.971043 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:16:21.971043 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:16:21.971043 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:16:21.971043 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:16:21.971043 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:16:21.971043 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:16:21.971043 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:16:21.971043 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:16:21.971043 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d92778a-fe09-4720-8b6c-a9f5a7aea57f could not be found. Sep 04 16:16:21.971043 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:16:21.971043 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:16:21.971043 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:16:21.971043 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:16:21.971043 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:16:21.971043 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:16:21.971043 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:16:21.971043 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:16:21.971043 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:16:21.972438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:16:21.972438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:16:21.972438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:16:21.972438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:16:21.972438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:16:21.972438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:16:21.972438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:16:21.972438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d92778a-fe09-4720-8b6c-a9f5a7aea57f could not be found. Sep 04 16:16:21.972438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:16:21.972438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:16:21.972438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:16:21.972438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:16:21.972438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:16:21.972438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:16:21.972438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:16:21.972438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:16:21.972438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d92778a-fe09-4720-8b6c-a9f5a7aea57f could not be found. Sep 04 16:16:21.972438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:16:21.974895 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-40a62417-7559-40c6-a218-7e710ce9fbb6 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] Returning 404 to user: Instance 4d92778a-fe09-4720-8b6c-a9f5a7aea57f could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:16:21.974895 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-40a62417-7559-40c6-a218-7e710ce9fbb6 tempest-VolumesNegativeTest-1974394696 tempest-VolumesNegativeTest-1974394696-project] 10.222.0.39 "GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f" status: 404 len: 111 microversion: 2.1 time: 0.045554 Sep 04 16:16:21.974895 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 175/353] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:21 2022] GET /compute/v2.1/servers/4d92778a-fe09-4720-8b6c-a9f5a7aea57f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 04 16:16:22.322577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-a6dbf374-443a-43b1-aa6b-84d6ad052327 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 16:16:22.322577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-a6dbf374-443a-43b1-aa6b-84d6ad052327 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 16:16:22.322577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-a6dbf374-443a-43b1-aa6b-84d6ad052327 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 16:16:22.322577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-a6dbf374-443a-43b1-aa6b-84d6ad052327 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 16:16:22.322577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-a6dbf374-443a-43b1-aa6b-84d6ad052327 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 16:16:22.340721 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a6dbf374-443a-43b1-aa6b-84d6ad052327 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:22.341510 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a6dbf374-443a-43b1-aa6b-84d6ad052327 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:22.342149 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a6dbf374-443a-43b1-aa6b-84d6ad052327 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:22.343025 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a6dbf374-443a-43b1-aa6b-84d6ad052327 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:22.343682 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a6dbf374-443a-43b1-aa6b-84d6ad052327 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:22.344375 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a6dbf374-443a-43b1-aa6b-84d6ad052327 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:22.367132 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-a6dbf374-443a-43b1-aa6b-84d6ad052327 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Getting quotas for project 1cc5ea4158344d5c8a35bc5783410620. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:16:22.371822 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-a6dbf374-443a-43b1-aa6b-84d6ad052327 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Getting quotas for user 6e5c22b631df4600b9f920120b67fc67 and project 1cc5ea4158344d5c8a35bc5783410620. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:16:22.407669 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a6dbf374-443a-43b1-aa6b-84d6ad052327 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 16:16:22.411643 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a6dbf374-443a-43b1-aa6b-84d6ad052327 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a460f6-29b0-46e6-ae98-e53ee2e13520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 16:16:22.445262 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-40f97a6d-c1cd-4224-a1fd-08d38e837cd8 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:22.446070 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-40f97a6d-c1cd-4224-a1fd-08d38e837cd8 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:22.459292 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40f97a6d-c1cd-4224-a1fd-08d38e837cd8 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:22.460246 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40f97a6d-c1cd-4224-a1fd-08d38e837cd8 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:22.462072 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40f97a6d-c1cd-4224-a1fd-08d38e837cd8 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:22.463029 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40f97a6d-c1cd-4224-a1fd-08d38e837cd8 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:22.463643 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40f97a6d-c1cd-4224-a1fd-08d38e837cd8 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:22.464221 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-40f97a6d-c1cd-4224-a1fd-08d38e837cd8 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:22.511275 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:16:22.535516 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a6dbf374-443a-43b1-aa6b-84d6ad052327 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.958838 Sep 04 16:16:22.537036 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 179/354] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Sep 4 16:16:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 04 16:16:22.553437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4c787102-a6a6-4d98-a3ef-87952e648c05 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:22.553437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4c787102-a6a6-4d98-a3ef-87952e648c05 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:22.625812 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4c787102-a6a6-4d98-a3ef-87952e648c05 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:22.637334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4c787102-a6a6-4d98-a3ef-87952e648c05 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1242 microversion: 2.1 time: 0.092217 Sep 04 16:16:22.649599 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 180/355] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:22 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:22.696605 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-40f97a6d-c1cd-4224-a1fd-08d38e837cd8 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lazy-loading 'services' on Instance uuid dea006b1-47f7-4cc7-aeb1-04ab2266daa5 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:16:22.935054 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7f820b71-cb1f-4d51-bea5-005c580cd0ec tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:22.936025 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7f820b71-cb1f-4d51-bea5-005c580cd0ec tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:22.944704 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7f820b71-cb1f-4d51-bea5-005c580cd0ec tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:22.945628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7f820b71-cb1f-4d51-bea5-005c580cd0ec tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:22.946261 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7f820b71-cb1f-4d51-bea5-005c580cd0ec tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:22.947194 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7f820b71-cb1f-4d51-bea5-005c580cd0ec tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:22.947915 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7f820b71-cb1f-4d51-bea5-005c580cd0ec tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:22.948434 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7f820b71-cb1f-4d51-bea5-005c580cd0ec tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:23.108137 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-40f97a6d-c1cd-4224-a1fd-08d38e837cd8 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "DELETE /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5/os-volume_attachments/17f7ddab-a16d-4e85-aa04-8bb9fdd64362" status: 202 len: 0 microversion: 2.1 time: 0.668877 Sep 04 16:16:23.109528 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 176/356] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Sep 4 16:16:22 2022] DELETE /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5/os-volume_attachments/17f7ddab-a16d-4e85-aa04-8bb9fdd64362 => generated 0 bytes in 671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 04 16:16:23.156287 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7f820b71-cb1f-4d51-bea5-005c580cd0ec tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:23.172801 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7f820b71-cb1f-4d51-bea5-005c580cd0ec tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:23.175845 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7f820b71-cb1f-4d51-bea5-005c580cd0ec tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:23.177605 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7f820b71-cb1f-4d51-bea5-005c580cd0ec tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1739 microversion: 2.20 time: 0.247039 Sep 04 16:16:23.178680 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 181/357] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:22 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1739 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:16:23.523333 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0e46fe30-2d3f-48cc-8ac2-b307702e1358 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Action: 'create', calling method: .version_select at 0x7f96894bf940>, body: {"keypair": {"name": "tempest-keypair-11298293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAEHrHBoxK+rNyGnyX1+KH6rUPpgOyiPYI4yFpNUiVdhnGCz9kW170leIVHKtzyW5SmwpnKhdTnOFPTussQ+VF/2FyZ0u+1qKd+qEMVaVNbo4UiEnJR9wup25P7fLH1PA=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:16:23.526822 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-0e46fe30-2d3f-48cc-8ac2-b307702e1358 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Getting quotas for project cb043a0ecad3466bbd5a5874126d2810. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:16:23.531419 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-0e46fe30-2d3f-48cc-8ac2-b307702e1358 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Getting quotas for user a9d55c52717546b09d93d956a29f49a9 and project cb043a0ecad3466bbd5a5874126d2810. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:16:23.638056 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0e46fe30-2d3f-48cc-8ac2-b307702e1358 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.135861 Sep 04 16:16:23.643436 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 177/358] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Sep 4 16:16:23 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:16:23.662749 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b30815f1-6d47-441e-9587-3e8020e044aa tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:23.663505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b30815f1-6d47-441e-9587-3e8020e044aa tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:23.756306 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b30815f1-6d47-441e-9587-3e8020e044aa tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:23.764861 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b30815f1-6d47-441e-9587-3e8020e044aa tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1242 microversion: 2.1 time: 0.107256 Sep 04 16:16:23.765991 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 182/359] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:23 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1242 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:24.204795 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-48a5dc6e-58aa-4d56-9e0a-6944f6488d5c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:24.206935 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-48a5dc6e-58aa-4d56-9e0a-6944f6488d5c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:24.214336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48a5dc6e-58aa-4d56-9e0a-6944f6488d5c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:24.215534 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48a5dc6e-58aa-4d56-9e0a-6944f6488d5c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:24.216329 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48a5dc6e-58aa-4d56-9e0a-6944f6488d5c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:24.227952 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48a5dc6e-58aa-4d56-9e0a-6944f6488d5c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:24.229964 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48a5dc6e-58aa-4d56-9e0a-6944f6488d5c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:24.230603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-48a5dc6e-58aa-4d56-9e0a-6944f6488d5c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:24.505501 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-48a5dc6e-58aa-4d56-9e0a-6944f6488d5c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:24.533391 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ee8e643a-3e3b-4a75-8768-1f09016709c3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1760918223", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2067148300", "security_groups": [{"name": "tempest-secgroup-smoke-2051237217"}], "networks": [{"uuid": "b2b9ef80-2b71-48ed-a94f-408f1798eb56"}], "block_device_mapping_v2": [{"uuid": "13652c2e-6ca9-4d68-8733-112ac5583bb3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:16:24.547117 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-48a5dc6e-58aa-4d56-9e0a-6944f6488d5c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:24.557412 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-48a5dc6e-58aa-4d56-9e0a-6944f6488d5c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:24.558548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-48a5dc6e-58aa-4d56-9e0a-6944f6488d5c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1739 microversion: 2.20 time: 0.356197 Sep 04 16:16:24.559771 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 178/360] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:24 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1739 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:24.773322 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-ee8e643a-3e3b-4a75-8768-1f09016709c3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] validate_networks() for [('b2b9ef80-2b71-48ed-a94f-408f1798eb56', None, None, None, None, None)] {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 16:16:24.801837 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a5dfcc3f-11f1-4597-bb12-862706717dac tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:24.806034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a5dfcc3f-11f1-4597-bb12-862706717dac tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:24.855321 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5dfcc3f-11f1-4597-bb12-862706717dac tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:24.855828 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5dfcc3f-11f1-4597-bb12-862706717dac tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:24.858531 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5dfcc3f-11f1-4597-bb12-862706717dac tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:24.862256 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5dfcc3f-11f1-4597-bb12-862706717dac tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:24.862256 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5dfcc3f-11f1-4597-bb12-862706717dac tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:24.862256 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a5dfcc3f-11f1-4597-bb12-862706717dac tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:24.980442 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a5dfcc3f-11f1-4597-bb12-862706717dac tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:24.992864 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a5dfcc3f-11f1-4597-bb12-862706717dac tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1294 microversion: 2.1 time: 0.206174 Sep 04 16:16:25.006807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 179/361] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:24 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1294 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:25.542889 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-ee8e643a-3e3b-4a75-8768-1f09016709c3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 16:16:25.543586 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-ee8e643a-3e3b-4a75-8768-1f09016709c3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 16:16:25.544691 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-ee8e643a-3e3b-4a75-8768-1f09016709c3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 16:16:25.545304 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-ee8e643a-3e3b-4a75-8768-1f09016709c3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 16:16:25.546597 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-ee8e643a-3e3b-4a75-8768-1f09016709c3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 16:16:25.582721 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3923f573-4749-403c-ad5c-eff8f6db72c0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:25.583468 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3923f573-4749-403c-ad5c-eff8f6db72c0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:25.583979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ee8e643a-3e3b-4a75-8768-1f09016709c3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:25.584819 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ee8e643a-3e3b-4a75-8768-1f09016709c3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:25.585402 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ee8e643a-3e3b-4a75-8768-1f09016709c3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:25.586474 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ee8e643a-3e3b-4a75-8768-1f09016709c3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:25.587194 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ee8e643a-3e3b-4a75-8768-1f09016709c3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:25.588040 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ee8e643a-3e3b-4a75-8768-1f09016709c3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:25.591971 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3923f573-4749-403c-ad5c-eff8f6db72c0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:25.595091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3923f573-4749-403c-ad5c-eff8f6db72c0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:25.595721 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3923f573-4749-403c-ad5c-eff8f6db72c0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:25.597065 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3923f573-4749-403c-ad5c-eff8f6db72c0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:25.597649 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3923f573-4749-403c-ad5c-eff8f6db72c0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:25.598085 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3923f573-4749-403c-ad5c-eff8f6db72c0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:25.633354 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-ee8e643a-3e3b-4a75-8768-1f09016709c3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Getting quotas for project 770dbd9183804e7fb0cbb99af75b45f2. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:16:25.641191 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-ee8e643a-3e3b-4a75-8768-1f09016709c3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Getting quotas for user 7796ec614f2545c29c2739d3dfd889f4 and project 770dbd9183804e7fb0cbb99af75b45f2. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:16:25.671277 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3923f573-4749-403c-ad5c-eff8f6db72c0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 16:16:25.807747 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ee8e643a-3e3b-4a75-8768-1f09016709c3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 16:16:25.810085 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ee8e643a-3e3b-4a75-8768-1f09016709c3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='13652c2e-6ca9-4d68-8733-112ac5583bb3',volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 16:16:26.634842 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3923f573-4749-403c-ad5c-eff8f6db72c0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "DELETE /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5" status: 204 len: 0 microversion: 2.1 time: 1.060981 Sep 04 16:16:26.636101 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 180/362] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:16:25 2022] DELETE /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5 => generated 0 bytes in 1063 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 04 16:16:26.643969 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9b52cda5-3ef1-475e-9c87-e193c91da4b4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:26.644926 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9b52cda5-3ef1-475e-9c87-e193c91da4b4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:26.652320 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b52cda5-3ef1-475e-9c87-e193c91da4b4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:26.653056 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b52cda5-3ef1-475e-9c87-e193c91da4b4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:26.653709 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b52cda5-3ef1-475e-9c87-e193c91da4b4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:26.655283 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b52cda5-3ef1-475e-9c87-e193c91da4b4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:26.655806 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b52cda5-3ef1-475e-9c87-e193c91da4b4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:26.656408 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b52cda5-3ef1-475e-9c87-e193c91da4b4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:26.822286 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ee8e643a-3e3b-4a75-8768-1f09016709c3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.292686 Sep 04 16:16:26.830298 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 183/363] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Sep 4 16:16:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 2301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 16:16:26.836713 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c17d0cd7-da59-4fe2-826a-8b62e2f1f31f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:26.837877 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c17d0cd7-da59-4fe2-826a-8b62e2f1f31f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:26.849584 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c17d0cd7-da59-4fe2-826a-8b62e2f1f31f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:26.850097 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c17d0cd7-da59-4fe2-826a-8b62e2f1f31f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:26.850571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c17d0cd7-da59-4fe2-826a-8b62e2f1f31f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:26.851988 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c17d0cd7-da59-4fe2-826a-8b62e2f1f31f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:26.852603 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c17d0cd7-da59-4fe2-826a-8b62e2f1f31f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:26.853080 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c17d0cd7-da59-4fe2-826a-8b62e2f1f31f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:26.891701 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-9b52cda5-3ef1-475e-9c87-e193c91da4b4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:26.914037 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-9b52cda5-3ef1-475e-9c87-e193c91da4b4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:26.923807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-9b52cda5-3ef1-475e-9c87-e193c91da4b4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:26.932023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9b52cda5-3ef1-475e-9c87-e193c91da4b4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1739 microversion: 2.20 time: 0.294343 Sep 04 16:16:26.934773 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 181/364] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:26 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1739 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:26.950925 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e12b31cc-ce09-4a1c-a8c9-eed83adb1e59 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:26.951786 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e12b31cc-ce09-4a1c-a8c9-eed83adb1e59 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:26.968418 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e12b31cc-ce09-4a1c-a8c9-eed83adb1e59 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:26.968919 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e12b31cc-ce09-4a1c-a8c9-eed83adb1e59 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:26.969394 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e12b31cc-ce09-4a1c-a8c9-eed83adb1e59 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:26.970118 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e12b31cc-ce09-4a1c-a8c9-eed83adb1e59 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:26.970573 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e12b31cc-ce09-4a1c-a8c9-eed83adb1e59 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:26.989714 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e12b31cc-ce09-4a1c-a8c9-eed83adb1e59 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:27.050846 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c17d0cd7-da59-4fe2-826a-8b62e2f1f31f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:27.063355 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c17d0cd7-da59-4fe2-826a-8b62e2f1f31f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1312 microversion: 2.1 time: 0.231008 Sep 04 16:16:27.080744 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 184/365] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:26 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1312 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:27.099133 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2a9e78d1-a25f-4080-9f99-fb7933f57dd7 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:27.099809 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2a9e78d1-a25f-4080-9f99-fb7933f57dd7 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:27.432941 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2a9e78d1-a25f-4080-9f99-fb7933f57dd7 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:27.440705 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2a9e78d1-a25f-4080-9f99-fb7933f57dd7 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1089 microversion: 2.1 time: 0.355125 Sep 04 16:16:27.456730 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 185/366] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:27 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1089 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:27.555818 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e12b31cc-ce09-4a1c-a8c9-eed83adb1e59 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:27.566962 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e12b31cc-ce09-4a1c-a8c9-eed83adb1e59 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5" status: 200 len: 1515 microversion: 2.1 time: 0.628366 Sep 04 16:16:27.567750 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 182/367] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:26 2022] GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5 => generated 1515 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:27.611049 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1250db67-0619-4fa2-960e-d6f689c85893 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1831970882", "imageRef": "11a460f6-29b0-46e6-ae98-e53ee2e13520", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a845be48-e7c6-44a4-9bea-76b6b11d7a03"}], "security_groups": [{"name": "tempest-securitygroup--1199755809"}], "key_name": "tempest-keypair-11298293", "user_data": "}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:16:27.966734 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-429edad8-8ce2-4e99-89dc-c79fb839af1a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:27.971349 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-429edad8-8ce2-4e99-89dc-c79fb839af1a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:27.992458 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-429edad8-8ce2-4e99-89dc-c79fb839af1a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:27.993542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-429edad8-8ce2-4e99-89dc-c79fb839af1a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:27.996890 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-429edad8-8ce2-4e99-89dc-c79fb839af1a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:27.998862 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-429edad8-8ce2-4e99-89dc-c79fb839af1a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:28.000760 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-429edad8-8ce2-4e99-89dc-c79fb839af1a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:28.004545 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-429edad8-8ce2-4e99-89dc-c79fb839af1a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:28.368352 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-429edad8-8ce2-4e99-89dc-c79fb839af1a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:28.379555 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-429edad8-8ce2-4e99-89dc-c79fb839af1a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:28.386926 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-429edad8-8ce2-4e99-89dc-c79fb839af1a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:28.389847 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-1250db67-0619-4fa2-960e-d6f689c85893 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] validate_networks() for [('a845be48-e7c6-44a4-9bea-76b6b11d7a03', None, None, None, None, None)] {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 16:16:28.390722 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-429edad8-8ce2-4e99-89dc-c79fb839af1a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1739 microversion: 2.20 time: 0.428279 Sep 04 16:16:28.394573 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 183/368] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:27 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1739 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:16:28.421097 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-83a30cdc-fee4-496a-b990-0d98a5dc3eba tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:28.421778 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-83a30cdc-fee4-496a-b990-0d98a5dc3eba tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:28.428931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83a30cdc-fee4-496a-b990-0d98a5dc3eba tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:28.429367 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83a30cdc-fee4-496a-b990-0d98a5dc3eba tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:28.429822 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83a30cdc-fee4-496a-b990-0d98a5dc3eba tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:28.435476 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83a30cdc-fee4-496a-b990-0d98a5dc3eba tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:28.435476 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83a30cdc-fee4-496a-b990-0d98a5dc3eba tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:28.435476 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-83a30cdc-fee4-496a-b990-0d98a5dc3eba tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:28.949426 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-83a30cdc-fee4-496a-b990-0d98a5dc3eba tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:28.960823 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-83a30cdc-fee4-496a-b990-0d98a5dc3eba tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1380 microversion: 2.1 time: 0.563169 Sep 04 16:16:28.981276 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 184/369] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:28 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1380 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:28.988852 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ea092f99-4316-4f00-8a5a-8197b41c3b1c tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:28.990477 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ea092f99-4316-4f00-8a5a-8197b41c3b1c tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:28.997638 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea092f99-4316-4f00-8a5a-8197b41c3b1c tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:28.998346 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea092f99-4316-4f00-8a5a-8197b41c3b1c tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:28.998960 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea092f99-4316-4f00-8a5a-8197b41c3b1c tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:29.000501 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea092f99-4316-4f00-8a5a-8197b41c3b1c tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:29.001134 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea092f99-4316-4f00-8a5a-8197b41c3b1c tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:29.001745 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea092f99-4316-4f00-8a5a-8197b41c3b1c tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:29.133845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ea092f99-4316-4f00-8a5a-8197b41c3b1c tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:29.146085 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ea092f99-4316-4f00-8a5a-8197b41c3b1c tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1139 microversion: 2.1 time: 0.161424 Sep 04 16:16:29.148450 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 185/370] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:28 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1139 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:29.153122 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a9992338-54bd-49fc-9063-9f7fa831ecad tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:29.153756 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a9992338-54bd-49fc-9063-9f7fa831ecad tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:29.175876 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9992338-54bd-49fc-9063-9f7fa831ecad tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:29.176753 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9992338-54bd-49fc-9063-9f7fa831ecad tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:29.178165 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9992338-54bd-49fc-9063-9f7fa831ecad tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:29.179103 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9992338-54bd-49fc-9063-9f7fa831ecad tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:29.179794 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9992338-54bd-49fc-9063-9f7fa831ecad tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:29.180294 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9992338-54bd-49fc-9063-9f7fa831ecad tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:29.613680 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a9992338-54bd-49fc-9063-9f7fa831ecad tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:29.629725 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a9992338-54bd-49fc-9063-9f7fa831ecad tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5" status: 200 len: 1515 microversion: 2.1 time: 0.480162 Sep 04 16:16:29.632602 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 186/371] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:29 2022] GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5 => generated 1515 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:29.648560 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-47de0f1b-3d77-4923-a35a-833c5f7f298f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:29.649361 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-47de0f1b-3d77-4923-a35a-833c5f7f298f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:29.665459 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47de0f1b-3d77-4923-a35a-833c5f7f298f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:29.671403 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47de0f1b-3d77-4923-a35a-833c5f7f298f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:29.672097 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47de0f1b-3d77-4923-a35a-833c5f7f298f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:29.673037 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47de0f1b-3d77-4923-a35a-833c5f7f298f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:29.673810 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47de0f1b-3d77-4923-a35a-833c5f7f298f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:29.674644 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-47de0f1b-3d77-4923-a35a-833c5f7f298f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:29.818485 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-1250db67-0619-4fa2-960e-d6f689c85893 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 16:16:29.820051 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-1250db67-0619-4fa2-960e-d6f689c85893 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 16:16:29.820801 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-1250db67-0619-4fa2-960e-d6f689c85893 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 16:16:29.821377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-1250db67-0619-4fa2-960e-d6f689c85893 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 16:16:29.822267 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-1250db67-0619-4fa2-960e-d6f689c85893 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 16:16:29.832461 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1250db67-0619-4fa2-960e-d6f689c85893 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:29.833229 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1250db67-0619-4fa2-960e-d6f689c85893 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:29.836461 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1250db67-0619-4fa2-960e-d6f689c85893 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:29.843008 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1250db67-0619-4fa2-960e-d6f689c85893 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:29.847422 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1250db67-0619-4fa2-960e-d6f689c85893 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:29.847422 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1250db67-0619-4fa2-960e-d6f689c85893 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:29.870631 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-1250db67-0619-4fa2-960e-d6f689c85893 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Getting quotas for project cb043a0ecad3466bbd5a5874126d2810. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:16:29.876675 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-1250db67-0619-4fa2-960e-d6f689c85893 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Getting quotas for user a9d55c52717546b09d93d956a29f49a9 and project cb043a0ecad3466bbd5a5874126d2810. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:16:29.906282 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1250db67-0619-4fa2-960e-d6f689c85893 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 16:16:29.910269 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1250db67-0619-4fa2-960e-d6f689c85893 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a460f6-29b0-46e6-ae98-e53ee2e13520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 16:16:30.103267 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-47de0f1b-3d77-4923-a35a-833c5f7f298f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:30.113072 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-47de0f1b-3d77-4923-a35a-833c5f7f298f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:30.118083 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-47de0f1b-3d77-4923-a35a-833c5f7f298f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:30.122944 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-47de0f1b-3d77-4923-a35a-833c5f7f298f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1739 microversion: 2.20 time: 0.489191 Sep 04 16:16:30.150065 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 187/372] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:29 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1739 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:30.150259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1250db67-0619-4fa2-960e-d6f689c85893 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.524058 Sep 04 16:16:30.150259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 186/373] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Sep 4 16:16:27 2022] POST /compute/v2.1/servers => generated 409 bytes in 2540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 16:16:30.155440 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5036e936-ff26-4930-91d7-de855f08e4ff tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:30.156351 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5036e936-ff26-4930-91d7-de855f08e4ff tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:30.163865 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5036e936-ff26-4930-91d7-de855f08e4ff tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:30.164745 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5036e936-ff26-4930-91d7-de855f08e4ff tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:30.165385 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5036e936-ff26-4930-91d7-de855f08e4ff tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:30.166313 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5036e936-ff26-4930-91d7-de855f08e4ff tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:30.166963 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5036e936-ff26-4930-91d7-de855f08e4ff tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:30.167601 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5036e936-ff26-4930-91d7-de855f08e4ff tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:30.173445 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b2b897f0-926d-4e0f-b233-d2ed5a9d2743 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:30.184355 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b2b897f0-926d-4e0f-b233-d2ed5a9d2743 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:30.326500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b2b897f0-926d-4e0f-b233-d2ed5a9d2743 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:30.335267 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b2b897f0-926d-4e0f-b233-d2ed5a9d2743 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1244 microversion: 2.1 time: 0.185296 Sep 04 16:16:30.342886 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 187/374] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:30 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1244 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:30.353072 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-53d3b674-ad8a-4822-8ac9-f065512e1cb8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:30.353943 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-53d3b674-ad8a-4822-8ac9-f065512e1cb8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:30.365298 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-53d3b674-ad8a-4822-8ac9-f065512e1cb8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:30.366177 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-53d3b674-ad8a-4822-8ac9-f065512e1cb8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:30.366788 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-53d3b674-ad8a-4822-8ac9-f065512e1cb8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:30.367652 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-53d3b674-ad8a-4822-8ac9-f065512e1cb8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:30.368466 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-53d3b674-ad8a-4822-8ac9-f065512e1cb8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:30.369048 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-53d3b674-ad8a-4822-8ac9-f065512e1cb8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:30.477303 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-53d3b674-ad8a-4822-8ac9-f065512e1cb8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:30.485377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-53d3b674-ad8a-4822-8ac9-f065512e1cb8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1187 microversion: 2.1 time: 0.141085 Sep 04 16:16:30.485988 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 188/375] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:30 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1187 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:30.574115 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5036e936-ff26-4930-91d7-de855f08e4ff tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:30.585653 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5036e936-ff26-4930-91d7-de855f08e4ff tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1368 microversion: 2.1 time: 0.446569 Sep 04 16:16:30.586588 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 188/376] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:30 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1368 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:30.649997 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-fa9a5908-ddea-4c41-bbd4-8925641e51f3 req-aa04ff16-bda5-4f4b-b8f9-a937b9cb387c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea006b1-47f7-4cc7-aeb1-04ab2266daa5", "name": "network-vif-deleted", "tag": "c990bd22-f4cb-4576-b878-e869548ceeb2"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:16:30.667486 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cd724d6e-973b-44a9-9001-6e41729f49ae tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:30.668117 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cd724d6e-973b-44a9-9001-6e41729f49ae tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:30.679999 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd724d6e-973b-44a9-9001-6e41729f49ae tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:30.680499 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd724d6e-973b-44a9-9001-6e41729f49ae tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:30.680910 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd724d6e-973b-44a9-9001-6e41729f49ae tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:30.681645 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd724d6e-973b-44a9-9001-6e41729f49ae tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:30.682109 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd724d6e-973b-44a9-9001-6e41729f49ae tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:30.682538 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd724d6e-973b-44a9-9001-6e41729f49ae tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:30.687383 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-fa9a5908-ddea-4c41-bbd4-8925641e51f3 req-aa04ff16-bda5-4f4b-b8f9-a937b9cb387c service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:30.688072 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-fa9a5908-ddea-4c41-bbd4-8925641e51f3 req-aa04ff16-bda5-4f4b-b8f9-a937b9cb387c service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:30.690804 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-fa9a5908-ddea-4c41-bbd4-8925641e51f3 req-aa04ff16-bda5-4f4b-b8f9-a937b9cb387c service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:30.730624 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-fa9a5908-ddea-4c41-bbd4-8925641e51f3 req-aa04ff16-bda5-4f4b-b8f9-a937b9cb387c service nova] Creating event network-vif-deleted:c990bd22-f4cb-4576-b878-e869548ceeb2 for instance dea006b1-47f7-4cc7-aeb1-04ab2266daa5 on hv-cinder-85236 Sep 04 16:16:30.742129 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-fa9a5908-ddea-4c41-bbd4-8925641e51f3 req-aa04ff16-bda5-4f4b-b8f9-a937b9cb387c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095993 Sep 04 16:16:30.750159 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 189/377] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:16:30.845895 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-cd724d6e-973b-44a9-9001-6e41729f49ae tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:30.853781 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cd724d6e-973b-44a9-9001-6e41729f49ae tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5" status: 200 len: 1473 microversion: 2.1 time: 0.193554 Sep 04 16:16:30.854618 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 189/378] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:30 2022] GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5 => generated 1473 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:30.998459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-99c9b3ba-db94-4bbc-96d4-a27954ebedd0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2056647152", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2049353985", "security_groups": [{"name": "tempest-secgroup-smoke-2145735453"}], "block_device_mapping_v2": [{"uuid": "5d2bda1a-fd92-4f45-a833-57ed8ab7a4c0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2405227e-d5b0-44f1-b814-62bb7f0eb040"}]}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:16:31.016005 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:16:31.181834 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d3212b38-6fb0-4082-bed6-55cc2071150b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:31.181834 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d3212b38-6fb0-4082-bed6-55cc2071150b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:31.181834 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3212b38-6fb0-4082-bed6-55cc2071150b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:31.181834 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3212b38-6fb0-4082-bed6-55cc2071150b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:31.182564 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3212b38-6fb0-4082-bed6-55cc2071150b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:31.182564 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3212b38-6fb0-4082-bed6-55cc2071150b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:31.182564 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3212b38-6fb0-4082-bed6-55cc2071150b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:31.182564 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3212b38-6fb0-4082-bed6-55cc2071150b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:31.261356 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-99c9b3ba-db94-4bbc-96d4-a27954ebedd0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] validate_networks() for [('2405227e-d5b0-44f1-b814-62bb7f0eb040', None, None, None, None, None)] {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 16:16:31.526404 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d3212b38-6fb0-4082-bed6-55cc2071150b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:31.535651 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d3212b38-6fb0-4082-bed6-55cc2071150b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:31.537084 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d3212b38-6fb0-4082-bed6-55cc2071150b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:31.538269 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d3212b38-6fb0-4082-bed6-55cc2071150b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1739 microversion: 2.20 time: 0.378587 Sep 04 16:16:31.538835 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 190/379] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:31 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1739 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:16:31.549467 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f0585a5f-1617-439b-a2a2-6f3cf9b3de9f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:31.552991 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f0585a5f-1617-439b-a2a2-6f3cf9b3de9f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:31.628449 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f0585a5f-1617-439b-a2a2-6f3cf9b3de9f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:31.635498 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f0585a5f-1617-439b-a2a2-6f3cf9b3de9f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1244 microversion: 2.1 time: 0.095706 Sep 04 16:16:31.636078 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 191/380] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:31 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1244 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:31.640767 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a8f2cbb8-8251-45f5-a616-62ec0346f2e9 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:31.641390 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a8f2cbb8-8251-45f5-a616-62ec0346f2e9 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:31.647454 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8f2cbb8-8251-45f5-a616-62ec0346f2e9 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:31.647932 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8f2cbb8-8251-45f5-a616-62ec0346f2e9 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:31.648355 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8f2cbb8-8251-45f5-a616-62ec0346f2e9 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:31.649036 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8f2cbb8-8251-45f5-a616-62ec0346f2e9 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:31.649476 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8f2cbb8-8251-45f5-a616-62ec0346f2e9 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:31.649914 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a8f2cbb8-8251-45f5-a616-62ec0346f2e9 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:31.677353 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:16:31.724121 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a8f2cbb8-8251-45f5-a616-62ec0346f2e9 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:31.731549 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a8f2cbb8-8251-45f5-a616-62ec0346f2e9 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1195 microversion: 2.1 time: 0.094529 Sep 04 16:16:31.732193 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 192/381] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:31 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1195 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:31.737342 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f7f39da6-3ce6-48be-8663-733fd7389c20 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:31.738018 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f7f39da6-3ce6-48be-8663-733fd7389c20 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:31.743901 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f7f39da6-3ce6-48be-8663-733fd7389c20 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:31.744377 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f7f39da6-3ce6-48be-8663-733fd7389c20 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:31.749310 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f7f39da6-3ce6-48be-8663-733fd7389c20 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:31.753194 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f7f39da6-3ce6-48be-8663-733fd7389c20 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:31.753194 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f7f39da6-3ce6-48be-8663-733fd7389c20 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:31.753194 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f7f39da6-3ce6-48be-8663-733fd7389c20 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:31.902415 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-99c9b3ba-db94-4bbc-96d4-a27954ebedd0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 16:16:31.907792 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-99c9b3ba-db94-4bbc-96d4-a27954ebedd0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 16:16:31.907792 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-99c9b3ba-db94-4bbc-96d4-a27954ebedd0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 16:16:31.907792 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-99c9b3ba-db94-4bbc-96d4-a27954ebedd0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 16:16:31.907792 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-99c9b3ba-db94-4bbc-96d4-a27954ebedd0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 16:16:31.915772 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99c9b3ba-db94-4bbc-96d4-a27954ebedd0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:31.916341 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99c9b3ba-db94-4bbc-96d4-a27954ebedd0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:31.916780 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99c9b3ba-db94-4bbc-96d4-a27954ebedd0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:31.917500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99c9b3ba-db94-4bbc-96d4-a27954ebedd0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:31.918177 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99c9b3ba-db94-4bbc-96d4-a27954ebedd0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:31.918743 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99c9b3ba-db94-4bbc-96d4-a27954ebedd0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:31.938082 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f7f39da6-3ce6-48be-8663-733fd7389c20 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:31.940617 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-99c9b3ba-db94-4bbc-96d4-a27954ebedd0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Getting quotas for project 56e82ba24a474557af758826743136d9. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:16:31.944754 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-99c9b3ba-db94-4bbc-96d4-a27954ebedd0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Getting quotas for user b694f1163ef54b82b86e06bf825c57e4 and project 56e82ba24a474557af758826743136d9. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:16:31.946810 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f7f39da6-3ce6-48be-8663-733fd7389c20 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1368 microversion: 2.1 time: 0.213641 Sep 04 16:16:31.947651 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 193/382] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:31 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:31.961468 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d01b26b9-df14-4a80-8dce-33f791cbddf0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:31.962433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d01b26b9-df14-4a80-8dce-33f791cbddf0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:31.969206 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d01b26b9-df14-4a80-8dce-33f791cbddf0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:31.971426 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d01b26b9-df14-4a80-8dce-33f791cbddf0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:31.972086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d01b26b9-df14-4a80-8dce-33f791cbddf0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:31.972851 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d01b26b9-df14-4a80-8dce-33f791cbddf0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:31.974218 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d01b26b9-df14-4a80-8dce-33f791cbddf0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:31.974802 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d01b26b9-df14-4a80-8dce-33f791cbddf0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:32.022167 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-99c9b3ba-db94-4bbc-96d4-a27954ebedd0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 16:16:32.025210 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-99c9b3ba-db94-4bbc-96d4-a27954ebedd0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5d2bda1a-fd92-4f45-a833-57ed8ab7a4c0',volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 16:16:32.049017 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d01b26b9-df14-4a80-8dce-33f791cbddf0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:32.058437 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d01b26b9-df14-4a80-8dce-33f791cbddf0 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5" status: 200 len: 1473 microversion: 2.1 time: 0.109501 Sep 04 16:16:32.059017 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 194/383] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:31 2022] GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5 => generated 1473 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:32.482044 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-99c9b3ba-db94-4bbc-96d4-a27954ebedd0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.488182 Sep 04 16:16:32.483572 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 190/384] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Sep 4 16:16:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 16:16:32.496435 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-edbdff16-4430-495c-ada7-f89b2dc3c9c1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:32.499080 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-edbdff16-4430-495c-ada7-f89b2dc3c9c1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:32.567339 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5ef35b80-5a9e-4beb-9398-c081e88c0baa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:32.568982 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5ef35b80-5a9e-4beb-9398-c081e88c0baa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:32.576517 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-edbdff16-4430-495c-ada7-f89b2dc3c9c1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:32.582024 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ef35b80-5a9e-4beb-9398-c081e88c0baa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:32.584904 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-edbdff16-4430-495c-ada7-f89b2dc3c9c1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1095 microversion: 2.1 time: 0.092752 Sep 04 16:16:32.586066 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ef35b80-5a9e-4beb-9398-c081e88c0baa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:32.586768 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ef35b80-5a9e-4beb-9398-c081e88c0baa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:32.587850 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ef35b80-5a9e-4beb-9398-c081e88c0baa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:32.588522 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ef35b80-5a9e-4beb-9398-c081e88c0baa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:32.589176 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ef35b80-5a9e-4beb-9398-c081e88c0baa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:32.591617 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 195/385] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:32 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1095 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:32.618363 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:16:32.659187 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d49792df-73e9-4820-bf22-bd0ad4294420 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:32.660083 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d49792df-73e9-4820-bf22-bd0ad4294420 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:32.672245 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d49792df-73e9-4820-bf22-bd0ad4294420 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:32.672742 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d49792df-73e9-4820-bf22-bd0ad4294420 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:32.673180 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d49792df-73e9-4820-bf22-bd0ad4294420 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:32.673916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d49792df-73e9-4820-bf22-bd0ad4294420 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:32.674885 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d49792df-73e9-4820-bf22-bd0ad4294420 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:32.674885 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d49792df-73e9-4820-bf22-bd0ad4294420 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:32.766666 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d49792df-73e9-4820-bf22-bd0ad4294420 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:32.779367 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d49792df-73e9-4820-bf22-bd0ad4294420 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1248 microversion: 2.1 time: 0.124478 Sep 04 16:16:32.780451 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 196/386] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:32 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1248 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:32.786335 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4a6ea4c4-b0c8-4088-9640-353bb90f01fe tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:32.787366 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4a6ea4c4-b0c8-4088-9640-353bb90f01fe tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:32.798683 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5ef35b80-5a9e-4beb-9398-c081e88c0baa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:32.803651 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a6ea4c4-b0c8-4088-9640-353bb90f01fe tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:32.804360 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a6ea4c4-b0c8-4088-9640-353bb90f01fe tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:32.806124 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a6ea4c4-b0c8-4088-9640-353bb90f01fe tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:32.806977 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a6ea4c4-b0c8-4088-9640-353bb90f01fe tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:32.807439 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a6ea4c4-b0c8-4088-9640-353bb90f01fe tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:32.807867 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4a6ea4c4-b0c8-4088-9640-353bb90f01fe tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:32.809410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5ef35b80-5a9e-4beb-9398-c081e88c0baa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:32.810959 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5ef35b80-5a9e-4beb-9398-c081e88c0baa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:32.812126 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5ef35b80-5a9e-4beb-9398-c081e88c0baa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1739 microversion: 2.20 time: 0.251817 Sep 04 16:16:32.825589 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 191/387] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:32 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:16:32.825589 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-4de28995-18cb-4109-b8f0-b6588ce3d6b4 req-1625a938-194a-4b56-8b12-13908b7f35e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "512e46e1-9291-44b3-b609-c1147f105f76", "tag": "08dc8012-7cf0-4bba-b537-c92a01bb802d"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:16:32.827681 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-4de28995-18cb-4109-b8f0-b6588ce3d6b4 req-1625a938-194a-4b56-8b12-13908b7f35e7 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:32.828150 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-4de28995-18cb-4109-b8f0-b6588ce3d6b4 req-1625a938-194a-4b56-8b12-13908b7f35e7 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:32.828778 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-4de28995-18cb-4109-b8f0-b6588ce3d6b4 req-1625a938-194a-4b56-8b12-13908b7f35e7 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:32.840560 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-4de28995-18cb-4109-b8f0-b6588ce3d6b4 req-1625a938-194a-4b56-8b12-13908b7f35e7 service nova] Creating event network-changed:08dc8012-7cf0-4bba-b537-c92a01bb802d for instance 512e46e1-9291-44b3-b609-c1147f105f76 on hv-cinder-85236 Sep 04 16:16:32.846564 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-4de28995-18cb-4109-b8f0-b6588ce3d6b4 req-1625a938-194a-4b56-8b12-13908b7f35e7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031752 Sep 04 16:16:32.847668 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 192/388] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:16:32.886546 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4a6ea4c4-b0c8-4088-9640-353bb90f01fe tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:32.896197 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4a6ea4c4-b0c8-4088-9640-353bb90f01fe tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1195 microversion: 2.1 time: 0.114495 Sep 04 16:16:32.896773 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 197/389] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:32 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1195 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:32.971793 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f03e12c1-b24f-4f99-8e26-3b7c1793684f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:32.973085 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f03e12c1-b24f-4f99-8e26-3b7c1793684f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:32.986502 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f03e12c1-b24f-4f99-8e26-3b7c1793684f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:32.987750 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f03e12c1-b24f-4f99-8e26-3b7c1793684f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:32.987750 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f03e12c1-b24f-4f99-8e26-3b7c1793684f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:32.993479 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f03e12c1-b24f-4f99-8e26-3b7c1793684f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:32.994292 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f03e12c1-b24f-4f99-8e26-3b7c1793684f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:32.994884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f03e12c1-b24f-4f99-8e26-3b7c1793684f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:33.087665 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-76e793b9-8968-477c-85fb-b423139b7e5d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:33.088284 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-76e793b9-8968-477c-85fb-b423139b7e5d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:33.094727 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76e793b9-8968-477c-85fb-b423139b7e5d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:33.095322 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76e793b9-8968-477c-85fb-b423139b7e5d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:33.095885 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76e793b9-8968-477c-85fb-b423139b7e5d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:33.096621 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76e793b9-8968-477c-85fb-b423139b7e5d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:33.096984 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76e793b9-8968-477c-85fb-b423139b7e5d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:33.097396 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-76e793b9-8968-477c-85fb-b423139b7e5d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:33.243478 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-76e793b9-8968-477c-85fb-b423139b7e5d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:33.252116 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-76e793b9-8968-477c-85fb-b423139b7e5d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5" status: 200 len: 1304 microversion: 2.1 time: 0.168349 Sep 04 16:16:33.252952 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 198/390] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:33 2022] GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5 => generated 1304 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:33.516867 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f03e12c1-b24f-4f99-8e26-3b7c1793684f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:33.537073 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f03e12c1-b24f-4f99-8e26-3b7c1793684f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1368 microversion: 2.1 time: 0.562473 Sep 04 16:16:33.537073 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 193/391] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:32 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1368 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:33.622886 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c1186950-89dc-43a8-bb84-b635f10d0afc tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:33.624298 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c1186950-89dc-43a8-bb84-b635f10d0afc tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:33.812279 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-30a5049d-9bc0-4997-827f-b8dc9fe73a1e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:33.813753 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-30a5049d-9bc0-4997-827f-b8dc9fe73a1e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:33.832753 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30a5049d-9bc0-4997-827f-b8dc9fe73a1e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:33.838131 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30a5049d-9bc0-4997-827f-b8dc9fe73a1e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:33.842989 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30a5049d-9bc0-4997-827f-b8dc9fe73a1e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:33.843874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30a5049d-9bc0-4997-827f-b8dc9fe73a1e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:33.844370 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30a5049d-9bc0-4997-827f-b8dc9fe73a1e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:33.844971 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30a5049d-9bc0-4997-827f-b8dc9fe73a1e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:34.124900 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c1186950-89dc-43a8-bb84-b635f10d0afc tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:34.156268 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c1186950-89dc-43a8-bb84-b635f10d0afc tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1095 microversion: 2.1 time: 0.541586 Sep 04 16:16:34.157024 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 199/392] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:33 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1095 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:34.163202 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3fa35399-77a7-4ac6-9e6b-f1e8fcc530fe tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:34.163809 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3fa35399-77a7-4ac6-9e6b-f1e8fcc530fe tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:34.173623 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fa35399-77a7-4ac6-9e6b-f1e8fcc530fe tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:34.175252 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fa35399-77a7-4ac6-9e6b-f1e8fcc530fe tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:34.180115 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fa35399-77a7-4ac6-9e6b-f1e8fcc530fe tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:34.181042 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fa35399-77a7-4ac6-9e6b-f1e8fcc530fe tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:34.181856 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fa35399-77a7-4ac6-9e6b-f1e8fcc530fe tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:34.182465 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3fa35399-77a7-4ac6-9e6b-f1e8fcc530fe tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:34.189179 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-30a5049d-9bc0-4997-827f-b8dc9fe73a1e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:34.200694 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-30a5049d-9bc0-4997-827f-b8dc9fe73a1e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1296 microversion: 2.1 time: 0.394134 Sep 04 16:16:34.201993 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 194/393] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:33 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1296 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:34.240191 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1b03ecc9-e728-48c0-9fbe-760bd1ed0bb3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:34.243178 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1b03ecc9-e728-48c0-9fbe-760bd1ed0bb3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:34.266866 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b03ecc9-e728-48c0-9fbe-760bd1ed0bb3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:34.315220 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b03ecc9-e728-48c0-9fbe-760bd1ed0bb3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:34.319292 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b03ecc9-e728-48c0-9fbe-760bd1ed0bb3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.049s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:34.327903 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b03ecc9-e728-48c0-9fbe-760bd1ed0bb3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:34.330924 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b03ecc9-e728-48c0-9fbe-760bd1ed0bb3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:34.331589 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b03ecc9-e728-48c0-9fbe-760bd1ed0bb3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:34.630446 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1b03ecc9-e728-48c0-9fbe-760bd1ed0bb3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:34.641226 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1b03ecc9-e728-48c0-9fbe-760bd1ed0bb3 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1205 microversion: 2.1 time: 0.438119 Sep 04 16:16:34.641826 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 195/394] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:34 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1205 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:34.656003 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7064d026-d6ee-4bc0-87f0-6d752bb93057 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:34.656971 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7064d026-d6ee-4bc0-87f0-6d752bb93057 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:34.664929 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7064d026-d6ee-4bc0-87f0-6d752bb93057 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:34.665880 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7064d026-d6ee-4bc0-87f0-6d752bb93057 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:34.669805 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7064d026-d6ee-4bc0-87f0-6d752bb93057 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:34.671057 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7064d026-d6ee-4bc0-87f0-6d752bb93057 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:34.671754 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7064d026-d6ee-4bc0-87f0-6d752bb93057 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:34.672517 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7064d026-d6ee-4bc0-87f0-6d752bb93057 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:34.727350 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7064d026-d6ee-4bc0-87f0-6d752bb93057 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:34.727837 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7064d026-d6ee-4bc0-87f0-6d752bb93057 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:34.728273 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7064d026-d6ee-4bc0-87f0-6d752bb93057 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:34.734837 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-7064d026-d6ee-4bc0-87f0-6d752bb93057 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lazy-loading 'fault' on Instance uuid dea006b1-47f7-4cc7-aeb1-04ab2266daa5 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:16:34.842448 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7064d026-d6ee-4bc0-87f0-6d752bb93057 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:34.848198 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-3fa35399-77a7-4ac6-9e6b-f1e8fcc530fe tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:34.870656 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-3fa35399-77a7-4ac6-9e6b-f1e8fcc530fe tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:34.871602 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7064d026-d6ee-4bc0-87f0-6d752bb93057 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5" status: 200 len: 1309 microversion: 2.1 time: 0.224829 Sep 04 16:16:34.873798 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-3fa35399-77a7-4ac6-9e6b-f1e8fcc530fe tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:34.875191 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 196/395] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:34 2022] GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5 => generated 1309 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:34.882828 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3fa35399-77a7-4ac6-9e6b-f1e8fcc530fe tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1739 microversion: 2.20 time: 0.724234 Sep 04 16:16:34.884870 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 200/396] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:34 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1739 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:34.886210 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fb520f92-75ea-40e4-bca8-5ac9a9419faf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:34.890636 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fb520f92-75ea-40e4-bca8-5ac9a9419faf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:34.901864 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb520f92-75ea-40e4-bca8-5ac9a9419faf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:34.901864 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb520f92-75ea-40e4-bca8-5ac9a9419faf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:34.902511 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb520f92-75ea-40e4-bca8-5ac9a9419faf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:34.904010 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb520f92-75ea-40e4-bca8-5ac9a9419faf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:34.904710 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb520f92-75ea-40e4-bca8-5ac9a9419faf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:34.905849 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb520f92-75ea-40e4-bca8-5ac9a9419faf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:35.183095 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-23c3b140-bcbc-4569-8aca-74772d15e626 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:35.183742 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-23c3b140-bcbc-4569-8aca-74772d15e626 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:35.200956 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23c3b140-bcbc-4569-8aca-74772d15e626 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:35.204067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23c3b140-bcbc-4569-8aca-74772d15e626 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:35.206287 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23c3b140-bcbc-4569-8aca-74772d15e626 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:35.208443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23c3b140-bcbc-4569-8aca-74772d15e626 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:35.210470 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23c3b140-bcbc-4569-8aca-74772d15e626 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:35.211073 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23c3b140-bcbc-4569-8aca-74772d15e626 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:35.501153 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-23c3b140-bcbc-4569-8aca-74772d15e626 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:35.512260 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-23c3b140-bcbc-4569-8aca-74772d15e626 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1137 microversion: 2.1 time: 0.333985 Sep 04 16:16:35.513138 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 201/397] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:35 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1137 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:35.536214 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-52d2ff05-51c5-4fa2-9245-4b93799507eb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:35.537078 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-52d2ff05-51c5-4fa2-9245-4b93799507eb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:35.547994 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52d2ff05-51c5-4fa2-9245-4b93799507eb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:35.549397 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52d2ff05-51c5-4fa2-9245-4b93799507eb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:35.550249 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52d2ff05-51c5-4fa2-9245-4b93799507eb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:35.551903 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52d2ff05-51c5-4fa2-9245-4b93799507eb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:35.552529 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52d2ff05-51c5-4fa2-9245-4b93799507eb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:35.553117 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-52d2ff05-51c5-4fa2-9245-4b93799507eb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:35.790182 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fb520f92-75ea-40e4-bca8-5ac9a9419faf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:35.809977 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fb520f92-75ea-40e4-bca8-5ac9a9419faf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1368 microversion: 2.1 time: 0.933389 Sep 04 16:16:35.810803 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 197/398] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:34 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1368 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:35.816359 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c7d837b0-bb89-4142-8f30-b4571864a443 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:35.817366 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c7d837b0-bb89-4142-8f30-b4571864a443 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:35.846918 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c7d837b0-bb89-4142-8f30-b4571864a443 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:35.851296 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-52d2ff05-51c5-4fa2-9245-4b93799507eb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:35.852411 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c7d837b0-bb89-4142-8f30-b4571864a443 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:35.852950 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c7d837b0-bb89-4142-8f30-b4571864a443 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:35.853951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c7d837b0-bb89-4142-8f30-b4571864a443 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:35.859074 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c7d837b0-bb89-4142-8f30-b4571864a443 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:35.860597 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c7d837b0-bb89-4142-8f30-b4571864a443 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:35.868999 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-52d2ff05-51c5-4fa2-9245-4b93799507eb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1304 microversion: 2.1 time: 0.341918 Sep 04 16:16:35.890489 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 202/399] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:35 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1304 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:35.905466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8e37df2d-1b80-4b22-a5a2-4eefb4d05a6e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:35.906655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8e37df2d-1b80-4b22-a5a2-4eefb4d05a6e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: dea006b1-47f7-4cc7-aeb1-04ab2266daa5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:35.915895 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e37df2d-1b80-4b22-a5a2-4eefb4d05a6e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:35.917886 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e37df2d-1b80-4b22-a5a2-4eefb4d05a6e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:35.917886 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e37df2d-1b80-4b22-a5a2-4eefb4d05a6e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:35.918681 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e37df2d-1b80-4b22-a5a2-4eefb4d05a6e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:35.919351 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e37df2d-1b80-4b22-a5a2-4eefb4d05a6e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:35.920859 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8e37df2d-1b80-4b22-a5a2-4eefb4d05a6e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:35.952578 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-8e37df2d-1b80-4b22-a5a2-4eefb4d05a6e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] HTTP exception thrown: Instance dea006b1-47f7-4cc7-aeb1-04ab2266daa5 could not be found. Sep 04 16:16:35.954746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8e37df2d-1b80-4b22-a5a2-4eefb4d05a6e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Request method failure captured: Sep 04 16:16:35.954746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5 HTTP/1.1 Sep 04 16:16:35.954746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:16:35.954746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:16:35.954746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:16:35.954746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 04 16:16:35.954746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:16:35.954746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:16:35.954746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:16:35.954746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:16:35.954746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFM8DAuud37HmWIb8g9iDlcJupcamkFPjBB8j0qBtNyC65puv9f6DdNj7CP4wjXiNhavEN7H4V2sbNvmrtJGt-_9ax0YU2qjsGUghy73EIF_6vlc4nzLwKhuYQh6ADa1nvm97CMCVXDtBp3B20qoMrUuolPsXx0RcHgww4D3zoM0W4Bs Sep 04 16:16:35.954746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:16:35.954746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:16:35.954746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:16:35.954746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:16:35.954746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:16:35.954746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:16:35.954746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: 9f1ae25e634d4380a6933101fb94ad2e Sep 04 16:16:35.954746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1231968782 Sep 04 16:16:35.954746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:16:35.954746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:16:35.956739 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9f1ae25e634d4380a6933101fb94ad2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9f1ae25e634d4380a6933101fb94ad2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9f1ae25e634d4380a6933101fb94ad2e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9f1ae25e634d4380a6933101fb94ad2e"}]}] Sep 04 16:16:35.956739 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-VolumesSnapshotTestJSON-1231968782 Sep 04 16:16:35.956739 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: 9f1ae25e634d4380a6933101fb94ad2e Sep 04 16:16:35.956739 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1231968782 Sep 04 16:16:35.956739 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-VolumesSnapshotTestJSON-1231968782-project Sep 04 16:16:35.956739 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:16:35.956739 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:16:35.956739 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: a8925da59209424fbd6375f056aee752 Sep 04 16:16:35.956739 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-VolumesSnapshotTestJSON-1231968782-project Sep 04 16:16:35.956739 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: > Sep 04 16:16:35.956739 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Instance dea006b1-47f7-4cc7-aeb1-04ab2266daa5 could not be found. Sep 04 16:16:35.956739 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'id': 'dea006b1-47f7-4cc7-aeb1-04ab2266daa5'} Sep 04 16:16:35.958053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:16:35.958053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:16:35.958053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:16:35.958053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:16:35.958053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:16:35.958053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:16:35.958053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:16:35.958053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:16:35.958053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:16:35.958053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:16:35.958053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dea006b1-47f7-4cc7-aeb1-04ab2266daa5 could not be found. Sep 04 16:16:35.958053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:16:35.958053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:16:35.958053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:16:35.958053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:16:35.958053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:16:35.958053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:16:35.958053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:16:35.958053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:16:35.958053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:16:35.960672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:16:35.960672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:16:35.960672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:16:35.960672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:16:35.960672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:16:35.960672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:16:35.960672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:16:35.960672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dea006b1-47f7-4cc7-aeb1-04ab2266daa5 could not be found. Sep 04 16:16:35.960672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:16:35.960672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:16:35.960672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:16:35.960672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:16:35.960672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:16:35.960672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:16:35.960672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:16:35.960672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:16:35.960672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dea006b1-47f7-4cc7-aeb1-04ab2266daa5 could not be found. Sep 04 16:16:35.960672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:16:35.963566 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8e37df2d-1b80-4b22-a5a2-4eefb4d05a6e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Returning 404 to user: Instance dea006b1-47f7-4cc7-aeb1-04ab2266daa5 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:16:35.964487 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8e37df2d-1b80-4b22-a5a2-4eefb4d05a6e tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5" status: 404 len: 111 microversion: 2.1 time: 0.066066 Sep 04 16:16:35.965038 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 203/400] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:35 2022] GET /compute/v2.1/servers/dea006b1-47f7-4cc7-aeb1-04ab2266daa5 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 04 16:16:35.983962 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-449a9c29-7362-4e83-b815-6c352a8c4253 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:35.986947 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-449a9c29-7362-4e83-b815-6c352a8c4253 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:35.998467 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-449a9c29-7362-4e83-b815-6c352a8c4253 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:35.999120 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-449a9c29-7362-4e83-b815-6c352a8c4253 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:35.999704 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-449a9c29-7362-4e83-b815-6c352a8c4253 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:36.000585 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-449a9c29-7362-4e83-b815-6c352a8c4253 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:36.001240 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-449a9c29-7362-4e83-b815-6c352a8c4253 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:36.001842 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-449a9c29-7362-4e83-b815-6c352a8c4253 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:36.028662 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c7d837b0-bb89-4142-8f30-b4571864a443 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:36.045397 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c7d837b0-bb89-4142-8f30-b4571864a443 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1193 microversion: 2.1 time: 0.233145 Sep 04 16:16:36.046054 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 198/401] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:35 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1193 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:36.424691 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-449a9c29-7362-4e83-b815-6c352a8c4253 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:36.434836 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-449a9c29-7362-4e83-b815-6c352a8c4253 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:36.436436 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-449a9c29-7362-4e83-b815-6c352a8c4253 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:36.438013 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-449a9c29-7362-4e83-b815-6c352a8c4253 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1739 microversion: 2.20 time: 0.471407 Sep 04 16:16:36.446188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 204/402] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:35 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1739 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:36.544327 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4b8e4aff-7045-489c-ba0d-d818c6859598 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:36.545225 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4b8e4aff-7045-489c-ba0d-d818c6859598 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:36.572674 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4b8e4aff-7045-489c-ba0d-d818c6859598 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:36.573699 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4b8e4aff-7045-489c-ba0d-d818c6859598 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:36.574456 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4b8e4aff-7045-489c-ba0d-d818c6859598 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:36.575497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4b8e4aff-7045-489c-ba0d-d818c6859598 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:36.575954 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4b8e4aff-7045-489c-ba0d-d818c6859598 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:36.576531 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4b8e4aff-7045-489c-ba0d-d818c6859598 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:36.745593 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4b8e4aff-7045-489c-ba0d-d818c6859598 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:36.753762 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4b8e4aff-7045-489c-ba0d-d818c6859598 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1193 microversion: 2.1 time: 0.214904 Sep 04 16:16:36.754335 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 199/403] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:36 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1193 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:36.836849 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-10032382-f5ae-419d-bb5b-2ffba4c6c4a1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:36.837984 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-10032382-f5ae-419d-bb5b-2ffba4c6c4a1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:36.845037 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10032382-f5ae-419d-bb5b-2ffba4c6c4a1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:36.845530 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10032382-f5ae-419d-bb5b-2ffba4c6c4a1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:36.846454 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10032382-f5ae-419d-bb5b-2ffba4c6c4a1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:36.847357 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10032382-f5ae-419d-bb5b-2ffba4c6c4a1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:36.847814 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10032382-f5ae-419d-bb5b-2ffba4c6c4a1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:36.848593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-10032382-f5ae-419d-bb5b-2ffba4c6c4a1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:36.898900 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7f4d9cd5-0919-464e-8ea5-fd57875efc0f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:36.900191 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7f4d9cd5-0919-464e-8ea5-fd57875efc0f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:36.906713 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7f4d9cd5-0919-464e-8ea5-fd57875efc0f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:36.907198 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7f4d9cd5-0919-464e-8ea5-fd57875efc0f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:36.907831 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7f4d9cd5-0919-464e-8ea5-fd57875efc0f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:36.909294 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7f4d9cd5-0919-464e-8ea5-fd57875efc0f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:36.909941 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7f4d9cd5-0919-464e-8ea5-fd57875efc0f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:36.910679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7f4d9cd5-0919-464e-8ea5-fd57875efc0f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:37.041078 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7f4d9cd5-0919-464e-8ea5-fd57875efc0f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:37.065483 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7f4d9cd5-0919-464e-8ea5-fd57875efc0f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1302 microversion: 2.1 time: 0.170331 Sep 04 16:16:37.069216 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 200/404] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:36 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1302 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:37.090311 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cfb51ba1-b165-4651-a716-6ae861ca4632 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:37.091535 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cfb51ba1-b165-4651-a716-6ae861ca4632 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:37.119108 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cfb51ba1-b165-4651-a716-6ae861ca4632 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:37.119756 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cfb51ba1-b165-4651-a716-6ae861ca4632 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:37.122580 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cfb51ba1-b165-4651-a716-6ae861ca4632 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:37.123711 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cfb51ba1-b165-4651-a716-6ae861ca4632 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:37.126113 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cfb51ba1-b165-4651-a716-6ae861ca4632 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:37.127927 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cfb51ba1-b165-4651-a716-6ae861ca4632 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:37.261040 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-10032382-f5ae-419d-bb5b-2ffba4c6c4a1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:37.270285 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-10032382-f5ae-419d-bb5b-2ffba4c6c4a1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1368 microversion: 2.1 time: 0.437341 Sep 04 16:16:37.271474 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 205/405] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:36 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1368 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:37.463504 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7f27cfba-40d5-48f2-a2e9-1e36fd5e0b88 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:37.464340 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7f27cfba-40d5-48f2-a2e9-1e36fd5e0b88 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:37.472188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f27cfba-40d5-48f2-a2e9-1e36fd5e0b88 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:37.472928 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f27cfba-40d5-48f2-a2e9-1e36fd5e0b88 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:37.473532 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f27cfba-40d5-48f2-a2e9-1e36fd5e0b88 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:37.474407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f27cfba-40d5-48f2-a2e9-1e36fd5e0b88 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:37.475018 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f27cfba-40d5-48f2-a2e9-1e36fd5e0b88 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:37.475709 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7f27cfba-40d5-48f2-a2e9-1e36fd5e0b88 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:37.594005 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-cfb51ba1-b165-4651-a716-6ae861ca4632 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:37.603217 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cfb51ba1-b165-4651-a716-6ae861ca4632 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1261 microversion: 2.1 time: 0.517684 Sep 04 16:16:37.604144 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 201/406] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:37 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1261 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:37.778809 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e5312db3-645a-40db-a110-2d296db5d1b6 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:37.779358 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e5312db3-645a-40db-a110-2d296db5d1b6 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:37.785741 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e5312db3-645a-40db-a110-2d296db5d1b6 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:37.786221 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e5312db3-645a-40db-a110-2d296db5d1b6 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:37.786652 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e5312db3-645a-40db-a110-2d296db5d1b6 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:37.787575 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e5312db3-645a-40db-a110-2d296db5d1b6 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:37.788028 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e5312db3-645a-40db-a110-2d296db5d1b6 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:37.788451 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e5312db3-645a-40db-a110-2d296db5d1b6 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:37.818757 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7f27cfba-40d5-48f2-a2e9-1e36fd5e0b88 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:37.827160 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7f27cfba-40d5-48f2-a2e9-1e36fd5e0b88 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:37.830414 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7f27cfba-40d5-48f2-a2e9-1e36fd5e0b88 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:37.831579 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7f27cfba-40d5-48f2-a2e9-1e36fd5e0b88 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1739 microversion: 2.20 time: 0.371982 Sep 04 16:16:37.832167 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 206/407] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:37 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1739 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:16:37.877977 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e5312db3-645a-40db-a110-2d296db5d1b6 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:37.885983 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e5312db3-645a-40db-a110-2d296db5d1b6 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1201 microversion: 2.1 time: 0.111082 Sep 04 16:16:37.886530 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 202/408] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:37 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1201 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:38.105938 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f49dd078-71ef-4ac9-9204-e1e40127d235 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:38.107120 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f49dd078-71ef-4ac9-9204-e1e40127d235 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:38.117977 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f49dd078-71ef-4ac9-9204-e1e40127d235 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:38.120989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f49dd078-71ef-4ac9-9204-e1e40127d235 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:38.131930 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f49dd078-71ef-4ac9-9204-e1e40127d235 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:38.137166 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f49dd078-71ef-4ac9-9204-e1e40127d235 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:38.137166 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f49dd078-71ef-4ac9-9204-e1e40127d235 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:38.137166 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f49dd078-71ef-4ac9-9204-e1e40127d235 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:38.301681 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cfd6cbaf-5fec-407b-9268-df8b8ae4c43e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:38.309770 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cfd6cbaf-5fec-407b-9268-df8b8ae4c43e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:38.309770 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cfd6cbaf-5fec-407b-9268-df8b8ae4c43e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:38.310333 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cfd6cbaf-5fec-407b-9268-df8b8ae4c43e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:38.310804 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cfd6cbaf-5fec-407b-9268-df8b8ae4c43e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:38.311558 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cfd6cbaf-5fec-407b-9268-df8b8ae4c43e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:38.312015 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cfd6cbaf-5fec-407b-9268-df8b8ae4c43e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:38.312445 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cfd6cbaf-5fec-407b-9268-df8b8ae4c43e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:38.713937 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f49dd078-71ef-4ac9-9204-e1e40127d235 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:38.721792 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f49dd078-71ef-4ac9-9204-e1e40127d235 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1370 microversion: 2.1 time: 0.619699 Sep 04 16:16:38.722426 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 207/409] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:38 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1370 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:38.727125 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7425241e-8018-489b-a786-0265ccc18cba tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:38.727975 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7425241e-8018-489b-a786-0265ccc18cba tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:38.730107 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:16:38.735947 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7425241e-8018-489b-a786-0265ccc18cba tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:38.739666 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7425241e-8018-489b-a786-0265ccc18cba tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:38.739666 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7425241e-8018-489b-a786-0265ccc18cba tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:38.739666 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7425241e-8018-489b-a786-0265ccc18cba tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:38.739666 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7425241e-8018-489b-a786-0265ccc18cba tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:38.740012 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7425241e-8018-489b-a786-0265ccc18cba tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:38.744533 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-cfd6cbaf-5fec-407b-9268-df8b8ae4c43e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:38.752781 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cfd6cbaf-5fec-407b-9268-df8b8ae4c43e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1368 microversion: 2.1 time: 0.455213 Sep 04 16:16:38.753449 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 203/410] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:38 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1368 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:38.857809 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9acb6ca9-ea09-4f20-a131-e15764a27dcf tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:38.858413 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9acb6ca9-ea09-4f20-a131-e15764a27dcf tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:38.866108 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9acb6ca9-ea09-4f20-a131-e15764a27dcf tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:38.866108 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9acb6ca9-ea09-4f20-a131-e15764a27dcf tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:38.866108 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9acb6ca9-ea09-4f20-a131-e15764a27dcf tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:38.867006 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9acb6ca9-ea09-4f20-a131-e15764a27dcf tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:38.867455 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9acb6ca9-ea09-4f20-a131-e15764a27dcf tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:38.867872 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9acb6ca9-ea09-4f20-a131-e15764a27dcf tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:38.928406 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7425241e-8018-489b-a786-0265ccc18cba tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:38.936634 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7425241e-8018-489b-a786-0265ccc18cba tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1261 microversion: 2.1 time: 0.212931 Sep 04 16:16:38.937202 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 208/411] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:38 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1261 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:38.943307 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-07d84f4f-7486-4a1e-98fa-6d17eaac9a73 req-1f468bd9-c106-41c7-bd03-48c20eba551e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84acd9f2-8732-4d8b-843e-46e2ccd5e5cc", "tag": "b7aa303d-deea-4135-89b8-303faf88bdfe"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:16:38.952044 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-07d84f4f-7486-4a1e-98fa-6d17eaac9a73 req-1f468bd9-c106-41c7-bd03-48c20eba551e service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:38.952509 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-07d84f4f-7486-4a1e-98fa-6d17eaac9a73 req-1f468bd9-c106-41c7-bd03-48c20eba551e service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:38.952925 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-07d84f4f-7486-4a1e-98fa-6d17eaac9a73 req-1f468bd9-c106-41c7-bd03-48c20eba551e service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:38.963913 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-07d84f4f-7486-4a1e-98fa-6d17eaac9a73 req-1f468bd9-c106-41c7-bd03-48c20eba551e service nova] Creating event network-changed:b7aa303d-deea-4135-89b8-303faf88bdfe for instance 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc on hv-cinder-85236 Sep 04 16:16:38.968743 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-07d84f4f-7486-4a1e-98fa-6d17eaac9a73 req-1f468bd9-c106-41c7-bd03-48c20eba551e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029771 Sep 04 16:16:38.969333 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 209/412] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:16:38.975527 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-172d1c40-72bd-4324-aa70-4b648066a3ec tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:38.976198 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-172d1c40-72bd-4324-aa70-4b648066a3ec tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:38.982510 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-172d1c40-72bd-4324-aa70-4b648066a3ec tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:38.982977 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-172d1c40-72bd-4324-aa70-4b648066a3ec tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:38.983403 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-172d1c40-72bd-4324-aa70-4b648066a3ec tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:38.984083 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-172d1c40-72bd-4324-aa70-4b648066a3ec tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:38.984529 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-172d1c40-72bd-4324-aa70-4b648066a3ec tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:38.984949 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-172d1c40-72bd-4324-aa70-4b648066a3ec tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:39.040265 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9acb6ca9-ea09-4f20-a131-e15764a27dcf tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:39.048449 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9acb6ca9-ea09-4f20-a131-e15764a27dcf tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:39.050275 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9acb6ca9-ea09-4f20-a131-e15764a27dcf tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:39.051555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9acb6ca9-ea09-4f20-a131-e15764a27dcf tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1739 microversion: 2.20 time: 0.198750 Sep 04 16:16:39.052333 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 204/413] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:38 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:16:39.057138 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-172d1c40-72bd-4324-aa70-4b648066a3ec tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:39.064745 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-172d1c40-72bd-4324-aa70-4b648066a3ec tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1201 microversion: 2.1 time: 0.094201 Sep 04 16:16:39.065292 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 210/414] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:38 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1201 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:39.744106 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-69bed58f-d7b7-44e1-91c1-cf3e81dbb0d4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:39.744708 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-69bed58f-d7b7-44e1-91c1-cf3e81dbb0d4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:39.751074 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69bed58f-d7b7-44e1-91c1-cf3e81dbb0d4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:39.751594 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69bed58f-d7b7-44e1-91c1-cf3e81dbb0d4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:39.752518 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69bed58f-d7b7-44e1-91c1-cf3e81dbb0d4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:39.753173 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69bed58f-d7b7-44e1-91c1-cf3e81dbb0d4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:39.753645 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69bed58f-d7b7-44e1-91c1-cf3e81dbb0d4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:39.754060 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69bed58f-d7b7-44e1-91c1-cf3e81dbb0d4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:39.776509 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-71b41ae2-bf8d-418c-9e34-b3e925c8725a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:39.777093 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-71b41ae2-bf8d-418c-9e34-b3e925c8725a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:39.784776 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71b41ae2-bf8d-418c-9e34-b3e925c8725a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:39.785311 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71b41ae2-bf8d-418c-9e34-b3e925c8725a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:39.786127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71b41ae2-bf8d-418c-9e34-b3e925c8725a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:39.791633 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71b41ae2-bf8d-418c-9e34-b3e925c8725a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:39.791633 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71b41ae2-bf8d-418c-9e34-b3e925c8725a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:39.791633 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71b41ae2-bf8d-418c-9e34-b3e925c8725a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:39.957707 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-69bed58f-d7b7-44e1-91c1-cf3e81dbb0d4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:39.964490 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-71b41ae2-bf8d-418c-9e34-b3e925c8725a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:39.966807 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-69bed58f-d7b7-44e1-91c1-cf3e81dbb0d4 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1370 microversion: 2.1 time: 0.226414 Sep 04 16:16:39.967779 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 205/415] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:39 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1370 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:39.972655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-71b41ae2-bf8d-418c-9e34-b3e925c8725a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1368 microversion: 2.1 time: 0.200187 Sep 04 16:16:39.973508 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-07fbbe05-b44c-495d-b850-82376efc6b57 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:39.973666 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 211/416] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:39 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1368 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:39.974432 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-07fbbe05-b44c-495d-b850-82376efc6b57 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:39.982555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-07fbbe05-b44c-495d-b850-82376efc6b57 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:39.983566 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-07fbbe05-b44c-495d-b850-82376efc6b57 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:39.984055 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-07fbbe05-b44c-495d-b850-82376efc6b57 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:39.984708 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-07fbbe05-b44c-495d-b850-82376efc6b57 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:39.985161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-07fbbe05-b44c-495d-b850-82376efc6b57 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:39.985601 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-07fbbe05-b44c-495d-b850-82376efc6b57 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:40.079660 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-87df638e-304c-4543-9828-21abd7ed8de3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:40.080835 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-87df638e-304c-4543-9828-21abd7ed8de3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:40.089379 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87df638e-304c-4543-9828-21abd7ed8de3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:40.093531 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87df638e-304c-4543-9828-21abd7ed8de3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:40.093531 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87df638e-304c-4543-9828-21abd7ed8de3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:40.093531 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87df638e-304c-4543-9828-21abd7ed8de3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:40.093531 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87df638e-304c-4543-9828-21abd7ed8de3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:40.093942 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-87df638e-304c-4543-9828-21abd7ed8de3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:40.111781 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:16:40.126061 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-07fbbe05-b44c-495d-b850-82376efc6b57 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:40.135166 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-07fbbe05-b44c-495d-b850-82376efc6b57 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1261 microversion: 2.1 time: 0.165896 Sep 04 16:16:40.135744 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 206/417] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:39 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:40.140743 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a86a6428-2157-40b0-b0e2-ef14c52b09ac tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:40.141371 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a86a6428-2157-40b0-b0e2-ef14c52b09ac tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:40.148472 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a86a6428-2157-40b0-b0e2-ef14c52b09ac tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:40.148948 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a86a6428-2157-40b0-b0e2-ef14c52b09ac tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:40.149378 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a86a6428-2157-40b0-b0e2-ef14c52b09ac tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:40.150152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a86a6428-2157-40b0-b0e2-ef14c52b09ac tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:40.150601 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a86a6428-2157-40b0-b0e2-ef14c52b09ac tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:40.153296 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a86a6428-2157-40b0-b0e2-ef14c52b09ac tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:40.228014 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a86a6428-2157-40b0-b0e2-ef14c52b09ac tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:40.235646 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a86a6428-2157-40b0-b0e2-ef14c52b09ac tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1201 microversion: 2.1 time: 0.098833 Sep 04 16:16:40.239063 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 207/418] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:40 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1201 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:40.250864 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-87df638e-304c-4543-9828-21abd7ed8de3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:40.259424 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-87df638e-304c-4543-9828-21abd7ed8de3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:40.260903 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-87df638e-304c-4543-9828-21abd7ed8de3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:40.262083 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-87df638e-304c-4543-9828-21abd7ed8de3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1739 microversion: 2.20 time: 0.187420 Sep 04 16:16:40.262638 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 212/419] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:40 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:40.994164 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5925188a-fad3-4806-86e1-0a570e019de5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:40.994773 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5925188a-fad3-4806-86e1-0a570e019de5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:40.997130 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ecdddfb4-fd8a-4f53-a30b-000f84a4528a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:40.998466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ecdddfb4-fd8a-4f53-a30b-000f84a4528a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:41.001492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5925188a-fad3-4806-86e1-0a570e019de5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:41.002406 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5925188a-fad3-4806-86e1-0a570e019de5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:41.003004 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5925188a-fad3-4806-86e1-0a570e019de5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:41.003989 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5925188a-fad3-4806-86e1-0a570e019de5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:41.007916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecdddfb4-fd8a-4f53-a30b-000f84a4528a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:41.008406 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecdddfb4-fd8a-4f53-a30b-000f84a4528a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:41.009267 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecdddfb4-fd8a-4f53-a30b-000f84a4528a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:41.010855 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecdddfb4-fd8a-4f53-a30b-000f84a4528a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:41.011250 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecdddfb4-fd8a-4f53-a30b-000f84a4528a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:41.011670 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ecdddfb4-fd8a-4f53-a30b-000f84a4528a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:41.017817 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5925188a-fad3-4806-86e1-0a570e019de5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:41.018645 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5925188a-fad3-4806-86e1-0a570e019de5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:41.025277 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:16:41.531321 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ecdddfb4-fd8a-4f53-a30b-000f84a4528a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:41.540959 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5925188a-fad3-4806-86e1-0a570e019de5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:41.546172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ecdddfb4-fd8a-4f53-a30b-000f84a4528a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1368 microversion: 2.1 time: 0.552835 Sep 04 16:16:41.548273 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 213/420] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:40 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1368 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:41.568061 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7202d373-983f-49cf-9b01-fb9488d819e7 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:41.568061 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7202d373-983f-49cf-9b01-fb9488d819e7 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:41.568257 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5925188a-fad3-4806-86e1-0a570e019de5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1370 microversion: 2.1 time: 0.573640 Sep 04 16:16:41.568257 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 208/421] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:40 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1370 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:41.568417 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7202d373-983f-49cf-9b01-fb9488d819e7 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:41.568417 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7202d373-983f-49cf-9b01-fb9488d819e7 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:41.568417 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7202d373-983f-49cf-9b01-fb9488d819e7 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:41.568417 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7202d373-983f-49cf-9b01-fb9488d819e7 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:41.568833 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7202d373-983f-49cf-9b01-fb9488d819e7 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:41.569264 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7202d373-983f-49cf-9b01-fb9488d819e7 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:41.571789 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fb7442e4-51f5-4066-8270-d462ac76e19a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:41.572994 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fb7442e4-51f5-4066-8270-d462ac76e19a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:41.581338 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb7442e4-51f5-4066-8270-d462ac76e19a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:41.582175 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb7442e4-51f5-4066-8270-d462ac76e19a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:41.583088 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb7442e4-51f5-4066-8270-d462ac76e19a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:41.584210 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb7442e4-51f5-4066-8270-d462ac76e19a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:41.584824 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb7442e4-51f5-4066-8270-d462ac76e19a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:41.585526 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb7442e4-51f5-4066-8270-d462ac76e19a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:41.740335 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fb7442e4-51f5-4066-8270-d462ac76e19a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:41.752927 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fb7442e4-51f5-4066-8270-d462ac76e19a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1211 microversion: 2.1 time: 0.185923 Sep 04 16:16:41.752927 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 209/422] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:41 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1211 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:41.757861 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-db071ad0-6e6e-4393-949d-93f2b077538f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:41.758843 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-db071ad0-6e6e-4393-949d-93f2b077538f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:41.770963 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-db071ad0-6e6e-4393-949d-93f2b077538f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:41.775925 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-db071ad0-6e6e-4393-949d-93f2b077538f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:41.775925 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-db071ad0-6e6e-4393-949d-93f2b077538f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:41.775925 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-db071ad0-6e6e-4393-949d-93f2b077538f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:41.775925 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-db071ad0-6e6e-4393-949d-93f2b077538f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:41.776376 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-db071ad0-6e6e-4393-949d-93f2b077538f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:41.930961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=8 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:16:41.951923 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=32 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:16:42.114311 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7202d373-983f-49cf-9b01-fb9488d819e7 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:42.122069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7202d373-983f-49cf-9b01-fb9488d819e7 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1261 microversion: 2.1 time: 0.572243 Sep 04 16:16:42.122636 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 214/423] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:41 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1261 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:42.216565 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-db071ad0-6e6e-4393-949d-93f2b077538f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:42.225036 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-db071ad0-6e6e-4393-949d-93f2b077538f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:42.226706 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-db071ad0-6e6e-4393-949d-93f2b077538f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:42.227920 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-db071ad0-6e6e-4393-949d-93f2b077538f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1721 microversion: 2.20 time: 0.473991 Sep 04 16:16:42.228486 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 210/424] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:41 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1721 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:42.527411 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-c452a281-8a19-4ed5-889c-9ba2d5b4b812 req-d52b4122-4789-493b-9e66-b444e48f779b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0188e4a8-e601-43da-b389-7e0a8410ae8d", "tag": "ab492967-90e3-4b09-b251-d08c6b91d22c"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:16:42.537176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c452a281-8a19-4ed5-889c-9ba2d5b4b812 req-d52b4122-4789-493b-9e66-b444e48f779b service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:42.537686 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c452a281-8a19-4ed5-889c-9ba2d5b4b812 req-d52b4122-4789-493b-9e66-b444e48f779b service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:42.538117 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c452a281-8a19-4ed5-889c-9ba2d5b4b812 req-d52b4122-4789-493b-9e66-b444e48f779b service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:42.549155 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-c452a281-8a19-4ed5-889c-9ba2d5b4b812 req-d52b4122-4789-493b-9e66-b444e48f779b service nova] Creating event network-changed:ab492967-90e3-4b09-b251-d08c6b91d22c for instance 0188e4a8-e601-43da-b389-7e0a8410ae8d on hv-cinder-85236 Sep 04 16:16:42.554448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-c452a281-8a19-4ed5-889c-9ba2d5b4b812 req-d52b4122-4789-493b-9e66-b444e48f779b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030657 Sep 04 16:16:42.555041 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 215/425] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:16:42.572542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8909095c-d692-4b14-8618-2744893b6d62 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:42.573406 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8909095c-d692-4b14-8618-2744893b6d62 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:42.579674 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8909095c-d692-4b14-8618-2744893b6d62 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:42.580323 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8909095c-d692-4b14-8618-2744893b6d62 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:42.580920 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8909095c-d692-4b14-8618-2744893b6d62 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:42.582070 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8909095c-d692-4b14-8618-2744893b6d62 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:42.582070 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8909095c-d692-4b14-8618-2744893b6d62 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:42.582630 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8909095c-d692-4b14-8618-2744893b6d62 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:42.590525 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0634d57b-c637-4e04-8d09-26331b927428 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:42.591726 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0634d57b-c637-4e04-8d09-26331b927428 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:42.599339 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0634d57b-c637-4e04-8d09-26331b927428 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:42.600127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0634d57b-c637-4e04-8d09-26331b927428 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:42.600867 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0634d57b-c637-4e04-8d09-26331b927428 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:42.601796 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0634d57b-c637-4e04-8d09-26331b927428 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:42.602741 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0634d57b-c637-4e04-8d09-26331b927428 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:42.603399 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0634d57b-c637-4e04-8d09-26331b927428 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:43.134389 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8909095c-d692-4b14-8618-2744893b6d62 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:43.141431 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8909095c-d692-4b14-8618-2744893b6d62 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1368 microversion: 2.1 time: 0.573086 Sep 04 16:16:43.156962 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 211/426] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:42 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1368 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:43.156962 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f6a927db-d90b-449c-be4a-2b4bebc033fd tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:43.157323 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0634d57b-c637-4e04-8d09-26331b927428 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:43.157798 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f6a927db-d90b-449c-be4a-2b4bebc033fd tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:43.157798 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f6a927db-d90b-449c-be4a-2b4bebc033fd tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:43.157966 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0634d57b-c637-4e04-8d09-26331b927428 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1370 microversion: 2.1 time: 0.570240 Sep 04 16:16:43.158042 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f6a927db-d90b-449c-be4a-2b4bebc033fd tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:43.158215 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 216/427] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:42 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1370 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:43.158363 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f6a927db-d90b-449c-be4a-2b4bebc033fd tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:43.158363 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f6a927db-d90b-449c-be4a-2b4bebc033fd tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:43.158363 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f6a927db-d90b-449c-be4a-2b4bebc033fd tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:43.158363 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f6a927db-d90b-449c-be4a-2b4bebc033fd tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:43.162845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c2248343-34a5-4a7c-a814-81c4024a97d7 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:43.163460 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c2248343-34a5-4a7c-a814-81c4024a97d7 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:43.171622 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2248343-34a5-4a7c-a814-81c4024a97d7 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:43.172111 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2248343-34a5-4a7c-a814-81c4024a97d7 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:43.172541 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2248343-34a5-4a7c-a814-81c4024a97d7 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:43.173430 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2248343-34a5-4a7c-a814-81c4024a97d7 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:43.174106 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2248343-34a5-4a7c-a814-81c4024a97d7 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:43.174640 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c2248343-34a5-4a7c-a814-81c4024a97d7 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:43.447402 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f6a927db-d90b-449c-be4a-2b4bebc033fd tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:43.456827 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f6a927db-d90b-449c-be4a-2b4bebc033fd tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1279 microversion: 2.1 time: 0.312859 Sep 04 16:16:43.458480 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 212/428] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:43 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1279 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:43.480008 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-36ae2fa1-391f-4cdd-a91a-2d846a08c794 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:43.482308 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-36ae2fa1-391f-4cdd-a91a-2d846a08c794 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:43.495058 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-36ae2fa1-391f-4cdd-a91a-2d846a08c794 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:43.495505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-36ae2fa1-391f-4cdd-a91a-2d846a08c794 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:43.496007 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-36ae2fa1-391f-4cdd-a91a-2d846a08c794 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:43.496715 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-36ae2fa1-391f-4cdd-a91a-2d846a08c794 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:43.497164 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-36ae2fa1-391f-4cdd-a91a-2d846a08c794 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:43.497602 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-36ae2fa1-391f-4cdd-a91a-2d846a08c794 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:43.521766 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c2248343-34a5-4a7c-a814-81c4024a97d7 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:43.532526 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c2248343-34a5-4a7c-a814-81c4024a97d7 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1261 microversion: 2.1 time: 0.375448 Sep 04 16:16:43.533153 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 217/429] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:43 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1261 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:43.908122 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-36ae2fa1-391f-4cdd-a91a-2d846a08c794 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:43.917670 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-36ae2fa1-391f-4cdd-a91a-2d846a08c794 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:43.919499 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-36ae2fa1-391f-4cdd-a91a-2d846a08c794 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:43.920753 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-36ae2fa1-391f-4cdd-a91a-2d846a08c794 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1721 microversion: 2.20 time: 0.461152 Sep 04 16:16:43.921507 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 213/430] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:43 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1721 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:44.165498 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4154059f-b617-4740-b0f0-4ccffcf4d7ef tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:44.166197 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4154059f-b617-4740-b0f0-4ccffcf4d7ef tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:44.168683 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=14 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:16:44.173369 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4154059f-b617-4740-b0f0-4ccffcf4d7ef tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:44.175160 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4154059f-b617-4740-b0f0-4ccffcf4d7ef tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:44.175328 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4154059f-b617-4740-b0f0-4ccffcf4d7ef tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:44.176035 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4154059f-b617-4740-b0f0-4ccffcf4d7ef tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:44.176578 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4154059f-b617-4740-b0f0-4ccffcf4d7ef tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:44.177008 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4154059f-b617-4740-b0f0-4ccffcf4d7ef tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:44.184981 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-62ed18fc-a4d7-4d9d-b5d0-a06af8f82871 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:44.186809 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-62ed18fc-a4d7-4d9d-b5d0-a06af8f82871 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:44.201516 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62ed18fc-a4d7-4d9d-b5d0-a06af8f82871 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:44.202426 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62ed18fc-a4d7-4d9d-b5d0-a06af8f82871 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:44.202994 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62ed18fc-a4d7-4d9d-b5d0-a06af8f82871 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:44.204113 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62ed18fc-a4d7-4d9d-b5d0-a06af8f82871 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:44.204615 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62ed18fc-a4d7-4d9d-b5d0-a06af8f82871 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:44.205776 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62ed18fc-a4d7-4d9d-b5d0-a06af8f82871 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:44.458214 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4154059f-b617-4740-b0f0-4ccffcf4d7ef tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:44.467521 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4154059f-b617-4740-b0f0-4ccffcf4d7ef tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1368 microversion: 2.1 time: 0.305130 Sep 04 16:16:44.483147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 218/431] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:44 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1368 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:44.483858 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-62ed18fc-a4d7-4d9d-b5d0-a06af8f82871 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:44.483858 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-62ed18fc-a4d7-4d9d-b5d0-a06af8f82871 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1370 microversion: 2.1 time: 0.301538 Sep 04 16:16:44.483858 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 214/432] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:44 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1370 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:44.490377 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-610d119e-7384-4309-8525-32cfbdc7aef8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:44.491088 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-610d119e-7384-4309-8525-32cfbdc7aef8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:44.498321 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-610d119e-7384-4309-8525-32cfbdc7aef8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:44.498888 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-610d119e-7384-4309-8525-32cfbdc7aef8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:44.499493 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-610d119e-7384-4309-8525-32cfbdc7aef8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:44.503633 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-610d119e-7384-4309-8525-32cfbdc7aef8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:44.503633 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-610d119e-7384-4309-8525-32cfbdc7aef8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:44.503633 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-610d119e-7384-4309-8525-32cfbdc7aef8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:44.556805 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-104b6eb7-cccd-4f69-8177-df9dd2e6f501 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:44.557467 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-104b6eb7-cccd-4f69-8177-df9dd2e6f501 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:44.567662 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-104b6eb7-cccd-4f69-8177-df9dd2e6f501 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:44.568690 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-104b6eb7-cccd-4f69-8177-df9dd2e6f501 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:44.570143 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-104b6eb7-cccd-4f69-8177-df9dd2e6f501 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:44.571684 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-104b6eb7-cccd-4f69-8177-df9dd2e6f501 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:44.572548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-104b6eb7-cccd-4f69-8177-df9dd2e6f501 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:44.573228 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-104b6eb7-cccd-4f69-8177-df9dd2e6f501 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:44.755873 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-610d119e-7384-4309-8525-32cfbdc7aef8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:44.764277 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-610d119e-7384-4309-8525-32cfbdc7aef8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1279 microversion: 2.1 time: 0.279169 Sep 04 16:16:44.764873 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 219/433] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:44 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1279 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:44.781387 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-ee0832da-0585-4755-87ec-5f0e4f0cb935 req-16f4bffd-eab2-437e-aa73-d4e9e1c9cd6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d24964d-b2cb-420a-9232-b5662800ec31", "tag": "16088940-01d4-4b7c-9350-5157b311afa1"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:16:44.791702 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-104b6eb7-cccd-4f69-8177-df9dd2e6f501 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:44.797016 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ee0832da-0585-4755-87ec-5f0e4f0cb935 req-16f4bffd-eab2-437e-aa73-d4e9e1c9cd6b service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:44.798370 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ee0832da-0585-4755-87ec-5f0e4f0cb935 req-16f4bffd-eab2-437e-aa73-d4e9e1c9cd6b service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:44.799197 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ee0832da-0585-4755-87ec-5f0e4f0cb935 req-16f4bffd-eab2-437e-aa73-d4e9e1c9cd6b service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:44.799881 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-104b6eb7-cccd-4f69-8177-df9dd2e6f501 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1261 microversion: 2.1 time: 0.247254 Sep 04 16:16:44.800787 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 215/434] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:44 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1261 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:44.815537 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-ee0832da-0585-4755-87ec-5f0e4f0cb935 req-16f4bffd-eab2-437e-aa73-d4e9e1c9cd6b service nova] Creating event network-changed:16088940-01d4-4b7c-9350-5157b311afa1 for instance 5d24964d-b2cb-420a-9232-b5662800ec31 on hv-cinder-85236 Sep 04 16:16:44.819671 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-ee0832da-0585-4755-87ec-5f0e4f0cb935 req-16f4bffd-eab2-437e-aa73-d4e9e1c9cd6b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044530 Sep 04 16:16:44.820517 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 220/435] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:16:44.946436 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-748ba362-d2b6-41cd-a7c5-6b052d090781 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:44.947107 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-748ba362-d2b6-41cd-a7c5-6b052d090781 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:44.953319 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-748ba362-d2b6-41cd-a7c5-6b052d090781 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:44.953826 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-748ba362-d2b6-41cd-a7c5-6b052d090781 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:44.954257 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-748ba362-d2b6-41cd-a7c5-6b052d090781 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:44.954964 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-748ba362-d2b6-41cd-a7c5-6b052d090781 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:44.955453 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-748ba362-d2b6-41cd-a7c5-6b052d090781 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:44.955867 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-748ba362-d2b6-41cd-a7c5-6b052d090781 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:45.088174 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-748ba362-d2b6-41cd-a7c5-6b052d090781 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:45.097232 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-748ba362-d2b6-41cd-a7c5-6b052d090781 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:45.098736 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-748ba362-d2b6-41cd-a7c5-6b052d090781 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:45.099997 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-748ba362-d2b6-41cd-a7c5-6b052d090781 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1724 microversion: 2.20 time: 0.157468 Sep 04 16:16:45.100639 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 216/436] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:44 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:45.124789 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c360d2c3-422a-4c79-ab95-5e16478995d7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f6c3a21-9f28-4890-ad74-769626740457"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:16:45.127945 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c360d2c3-422a-4c79-ab95-5e16478995d7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:45.134246 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c360d2c3-422a-4c79-ab95-5e16478995d7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:45.134732 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c360d2c3-422a-4c79-ab95-5e16478995d7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:45.135195 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c360d2c3-422a-4c79-ab95-5e16478995d7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:45.135919 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c360d2c3-422a-4c79-ab95-5e16478995d7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:45.136371 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c360d2c3-422a-4c79-ab95-5e16478995d7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:45.136791 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c360d2c3-422a-4c79-ab95-5e16478995d7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:45.497810 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fb182a5d-2a55-4b09-b3ee-6ecd3bb3614a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:45.498423 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fb182a5d-2a55-4b09-b3ee-6ecd3bb3614a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:45.505913 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb182a5d-2a55-4b09-b3ee-6ecd3bb3614a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:45.506394 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb182a5d-2a55-4b09-b3ee-6ecd3bb3614a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:45.506826 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb182a5d-2a55-4b09-b3ee-6ecd3bb3614a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:45.507513 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb182a5d-2a55-4b09-b3ee-6ecd3bb3614a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:45.507964 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb182a5d-2a55-4b09-b3ee-6ecd3bb3614a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:45.508380 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fb182a5d-2a55-4b09-b3ee-6ecd3bb3614a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:45.653170 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fb182a5d-2a55-4b09-b3ee-6ecd3bb3614a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:45.662632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fb182a5d-2a55-4b09-b3ee-6ecd3bb3614a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1368 microversion: 2.1 time: 0.168731 Sep 04 16:16:45.663376 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 217/437] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:45 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:45.672152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c2a6ecb2-18d5-4b32-b51f-48b938de4085 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:45.673604 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c2a6ecb2-18d5-4b32-b51f-48b938de4085 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:45.681681 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c2a6ecb2-18d5-4b32-b51f-48b938de4085 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:45.682165 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c2a6ecb2-18d5-4b32-b51f-48b938de4085 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:45.682642 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c2a6ecb2-18d5-4b32-b51f-48b938de4085 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:45.683338 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c2a6ecb2-18d5-4b32-b51f-48b938de4085 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:45.683781 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c2a6ecb2-18d5-4b32-b51f-48b938de4085 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:45.684199 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c2a6ecb2-18d5-4b32-b51f-48b938de4085 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:45.815778 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c2a6ecb2-18d5-4b32-b51f-48b938de4085 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:45.824647 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c2a6ecb2-18d5-4b32-b51f-48b938de4085 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1370 microversion: 2.1 time: 0.160275 Sep 04 16:16:45.826688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 218/438] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:45 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:45.829733 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1f803857-c2cb-4dba-b753-247b31eaf620 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:45.830939 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1f803857-c2cb-4dba-b753-247b31eaf620 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:45.836339 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1f803857-c2cb-4dba-b753-247b31eaf620 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:45.836821 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1f803857-c2cb-4dba-b753-247b31eaf620 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:45.837367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1f803857-c2cb-4dba-b753-247b31eaf620 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:45.838087 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1f803857-c2cb-4dba-b753-247b31eaf620 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:45.838545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1f803857-c2cb-4dba-b753-247b31eaf620 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:45.838962 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1f803857-c2cb-4dba-b753-247b31eaf620 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:45.976783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1f803857-c2cb-4dba-b753-247b31eaf620 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:45.984681 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1f803857-c2cb-4dba-b753-247b31eaf620 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1279 microversion: 2.1 time: 0.158497 Sep 04 16:16:45.985247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 219/439] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:45 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1279 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:45.990345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0b2733fc-507a-4112-b6b9-198e73dbeccb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:45.990948 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0b2733fc-507a-4112-b6b9-198e73dbeccb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:45.996729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0b2733fc-507a-4112-b6b9-198e73dbeccb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:45.997198 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0b2733fc-507a-4112-b6b9-198e73dbeccb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:45.997648 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0b2733fc-507a-4112-b6b9-198e73dbeccb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:45.998354 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0b2733fc-507a-4112-b6b9-198e73dbeccb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:45.998799 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0b2733fc-507a-4112-b6b9-198e73dbeccb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:45.999237 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0b2733fc-507a-4112-b6b9-198e73dbeccb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:46.101585 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c360d2c3-422a-4c79-ab95-5e16478995d7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "POST /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.981104 Sep 04 16:16:46.107548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 221/440] 10.222.0.39 () {62 vars in 1364 bytes} [Sun Sep 4 16:16:45 2022] POST /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-volume_attachments => generated 188 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:16:46.135663 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0b2733fc-507a-4112-b6b9-198e73dbeccb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:46.150435 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0b2733fc-507a-4112-b6b9-198e73dbeccb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1261 microversion: 2.1 time: 0.164045 Sep 04 16:16:46.151830 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 220/441] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:45 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:46.276262 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ff547ec3-c3c9-4150-a9aa-4e5e463dafab tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:16:46.277247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ff547ec3-c3c9-4150-a9aa-4e5e463dafab tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:46.285351 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff547ec3-c3c9-4150-a9aa-4e5e463dafab tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:46.285878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff547ec3-c3c9-4150-a9aa-4e5e463dafab tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:46.286316 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff547ec3-c3c9-4150-a9aa-4e5e463dafab tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:46.287013 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff547ec3-c3c9-4150-a9aa-4e5e463dafab tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:46.287722 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff547ec3-c3c9-4150-a9aa-4e5e463dafab tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:46.288223 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ff547ec3-c3c9-4150-a9aa-4e5e463dafab tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:46.349098 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ff547ec3-c3c9-4150-a9aa-4e5e463dafab tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121040) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 04 16:16:46.686975 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f3e7e54b-3608-4727-a77f-806ae4579f9d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:46.687640 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f3e7e54b-3608-4727-a77f-806ae4579f9d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:46.700609 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f3e7e54b-3608-4727-a77f-806ae4579f9d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:46.701100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f3e7e54b-3608-4727-a77f-806ae4579f9d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:46.701333 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ff547ec3-c3c9-4150-a9aa-4e5e463dafab tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "POST /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/action" status: 202 len: 0 microversion: 2.20 time: 0.429031 Sep 04 16:16:46.701532 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f3e7e54b-3608-4727-a77f-806ae4579f9d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:46.702278 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f3e7e54b-3608-4727-a77f-806ae4579f9d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:46.702726 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f3e7e54b-3608-4727-a77f-806ae4579f9d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:46.703141 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f3e7e54b-3608-4727-a77f-806ae4579f9d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:46.711261 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 222/442] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Sep 4 16:16:46 2022] POST /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 04 16:16:46.719957 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-edf51f7e-4341-49c7-ad61-62e3c7462daa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:46.722118 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-edf51f7e-4341-49c7-ad61-62e3c7462daa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:46.733131 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edf51f7e-4341-49c7-ad61-62e3c7462daa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:46.734075 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edf51f7e-4341-49c7-ad61-62e3c7462daa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:46.735669 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edf51f7e-4341-49c7-ad61-62e3c7462daa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:46.738203 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edf51f7e-4341-49c7-ad61-62e3c7462daa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:46.738957 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edf51f7e-4341-49c7-ad61-62e3c7462daa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:46.739707 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-edf51f7e-4341-49c7-ad61-62e3c7462daa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:47.085226 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f3e7e54b-3608-4727-a77f-806ae4579f9d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:47.086750 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-edf51f7e-4341-49c7-ad61-62e3c7462daa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:47.096336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-edf51f7e-4341-49c7-ad61-62e3c7462daa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:47.097141 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f3e7e54b-3608-4727-a77f-806ae4579f9d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1368 microversion: 2.1 time: 0.413810 Sep 04 16:16:47.097822 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-edf51f7e-4341-49c7-ad61-62e3c7462daa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:47.098074 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 221/443] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:46 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1368 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:47.099004 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-edf51f7e-4341-49c7-ad61-62e3c7462daa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1810 microversion: 2.20 time: 0.386384 Sep 04 16:16:47.101731 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 223/444] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:46 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1810 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:47.105205 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2128097b-0ddb-4629-af56-b19890c5291b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:47.105986 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2128097b-0ddb-4629-af56-b19890c5291b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:47.114117 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2128097b-0ddb-4629-af56-b19890c5291b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:47.114780 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2128097b-0ddb-4629-af56-b19890c5291b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:47.115374 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2128097b-0ddb-4629-af56-b19890c5291b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:47.116216 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2128097b-0ddb-4629-af56-b19890c5291b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:47.116826 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2128097b-0ddb-4629-af56-b19890c5291b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:47.117504 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2128097b-0ddb-4629-af56-b19890c5291b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:47.122559 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e80bf8da-cbce-440a-a1bf-9a01aee9c7ee tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-586871995", "imageRef": "11a460f6-29b0-46e6-ae98-e53ee2e13520", "flavorRef": "452", "networks": [{"uuid": "9dd59a90-1b88-4c82-b79b-5c099bf25a16"}]}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:16:47.183234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-e80bf8da-cbce-440a-a1bf-9a01aee9c7ee tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] validate_networks() for [('9dd59a90-1b88-4c82-b79b-5c099bf25a16', None, None, None, None, None)] {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 16:16:47.808609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2128097b-0ddb-4629-af56-b19890c5291b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:47.823218 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2128097b-0ddb-4629-af56-b19890c5291b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1370 microversion: 2.1 time: 0.718892 Sep 04 16:16:47.823218 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 224/445] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:47 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1370 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:47.825941 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-947e05e7-7d64-4a74-99d7-87d9fcf7c220 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:47.826786 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-947e05e7-7d64-4a74-99d7-87d9fcf7c220 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:47.833878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-947e05e7-7d64-4a74-99d7-87d9fcf7c220 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:47.834376 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-947e05e7-7d64-4a74-99d7-87d9fcf7c220 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:47.834802 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-947e05e7-7d64-4a74-99d7-87d9fcf7c220 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:47.835493 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-947e05e7-7d64-4a74-99d7-87d9fcf7c220 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:47.835944 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-947e05e7-7d64-4a74-99d7-87d9fcf7c220 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:47.836389 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-947e05e7-7d64-4a74-99d7-87d9fcf7c220 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:48.442953 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-947e05e7-7d64-4a74-99d7-87d9fcf7c220 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:48.455928 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-947e05e7-7d64-4a74-99d7-87d9fcf7c220 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1267 microversion: 2.1 time: 0.632903 Sep 04 16:16:48.457118 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 225/446] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:47 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1267 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:48.464084 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4e6cc9a3-aa60-4e16-8ed0-0952b68b94e4 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:48.465464 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4e6cc9a3-aa60-4e16-8ed0-0952b68b94e4 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:48.478705 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e6cc9a3-aa60-4e16-8ed0-0952b68b94e4 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:48.479587 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e6cc9a3-aa60-4e16-8ed0-0952b68b94e4 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:48.481667 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e6cc9a3-aa60-4e16-8ed0-0952b68b94e4 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:48.484124 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e6cc9a3-aa60-4e16-8ed0-0952b68b94e4 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:48.484838 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e6cc9a3-aa60-4e16-8ed0-0952b68b94e4 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:48.485424 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e6cc9a3-aa60-4e16-8ed0-0952b68b94e4 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:48.536519 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-e80bf8da-cbce-440a-a1bf-9a01aee9c7ee tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 16:16:48.536985 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-e80bf8da-cbce-440a-a1bf-9a01aee9c7ee tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 16:16:48.537400 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-e80bf8da-cbce-440a-a1bf-9a01aee9c7ee tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 16:16:48.538011 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-e80bf8da-cbce-440a-a1bf-9a01aee9c7ee tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 16:16:48.538424 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-e80bf8da-cbce-440a-a1bf-9a01aee9c7ee tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 16:16:48.548464 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e80bf8da-cbce-440a-a1bf-9a01aee9c7ee tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:48.549237 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e80bf8da-cbce-440a-a1bf-9a01aee9c7ee tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:48.549904 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e80bf8da-cbce-440a-a1bf-9a01aee9c7ee tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:48.550815 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e80bf8da-cbce-440a-a1bf-9a01aee9c7ee tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:48.551956 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e80bf8da-cbce-440a-a1bf-9a01aee9c7ee tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:48.553233 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e80bf8da-cbce-440a-a1bf-9a01aee9c7ee tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:48.574887 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-e80bf8da-cbce-440a-a1bf-9a01aee9c7ee tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Getting quotas for project 9f1ae25e634d4380a6933101fb94ad2e. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:16:48.590348 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-e80bf8da-cbce-440a-a1bf-9a01aee9c7ee tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Getting quotas for user a8925da59209424fbd6375f056aee752 and project 9f1ae25e634d4380a6933101fb94ad2e. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:16:48.606672 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e80bf8da-cbce-440a-a1bf-9a01aee9c7ee tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 16:16:48.610780 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e80bf8da-cbce-440a-a1bf-9a01aee9c7ee tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a460f6-29b0-46e6-ae98-e53ee2e13520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 16:16:48.678305 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4e6cc9a3-aa60-4e16-8ed0-0952b68b94e4 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:48.694191 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:16:48.694191 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4e6cc9a3-aa60-4e16-8ed0-0952b68b94e4 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1261 microversion: 2.1 time: 0.229240 Sep 04 16:16:48.694191 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 226/447] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:48 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1261 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:48.694191 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-90b26301-9ff4-401f-8751-f12ff7581d6f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:48.694191 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-90b26301-9ff4-401f-8751-f12ff7581d6f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:48.699646 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b26301-9ff4-401f-8751-f12ff7581d6f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:48.700125 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b26301-9ff4-401f-8751-f12ff7581d6f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:48.700554 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b26301-9ff4-401f-8751-f12ff7581d6f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:48.701234 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b26301-9ff4-401f-8751-f12ff7581d6f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:48.701720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b26301-9ff4-401f-8751-f12ff7581d6f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:48.702143 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90b26301-9ff4-401f-8751-f12ff7581d6f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:48.806672 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e80bf8da-cbce-440a-a1bf-9a01aee9c7ee tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.706861 Sep 04 16:16:48.807603 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 222/448] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Sep 4 16:16:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 16:16:48.816806 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-664e0ff8-3460-41f9-b0fc-322091bbf128 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:48.817472 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-664e0ff8-3460-41f9-b0fc-322091bbf128 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:48.823861 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-664e0ff8-3460-41f9-b0fc-322091bbf128 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:48.828737 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-664e0ff8-3460-41f9-b0fc-322091bbf128 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:48.828737 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-664e0ff8-3460-41f9-b0fc-322091bbf128 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:48.828737 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-664e0ff8-3460-41f9-b0fc-322091bbf128 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:48.828737 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-664e0ff8-3460-41f9-b0fc-322091bbf128 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:48.829179 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-664e0ff8-3460-41f9-b0fc-322091bbf128 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:48.872213 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-90b26301-9ff4-401f-8751-f12ff7581d6f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:48.881729 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-90b26301-9ff4-401f-8751-f12ff7581d6f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1368 microversion: 2.1 time: 0.192369 Sep 04 16:16:48.895592 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 227/449] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:48 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1368 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:48.903591 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-3052f52e-0bca-49be-81c3-85234b6f328c req-15b17693-87a3-4a2e-a670-a0f5814e32a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "512e46e1-9291-44b3-b609-c1147f105f76", "name": "network-vif-plugged", "status": "completed", "tag": "08dc8012-7cf0-4bba-b537-c92a01bb802d"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:16:48.919367 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3052f52e-0bca-49be-81c3-85234b6f328c req-15b17693-87a3-4a2e-a670-a0f5814e32a4 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:48.920835 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3052f52e-0bca-49be-81c3-85234b6f328c req-15b17693-87a3-4a2e-a670-a0f5814e32a4 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:48.921794 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-3052f52e-0bca-49be-81c3-85234b6f328c req-15b17693-87a3-4a2e-a670-a0f5814e32a4 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:48.946560 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-3052f52e-0bca-49be-81c3-85234b6f328c req-15b17693-87a3-4a2e-a670-a0f5814e32a4 service nova] Creating event network-vif-plugged:08dc8012-7cf0-4bba-b537-c92a01bb802d for instance 512e46e1-9291-44b3-b609-c1147f105f76 on hv-cinder-85236 Sep 04 16:16:48.946560 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-3052f52e-0bca-49be-81c3-85234b6f328c req-15b17693-87a3-4a2e-a670-a0f5814e32a4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048225 Sep 04 16:16:48.946560 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 228/450] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:16:48.957870 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8bfef3e9-3e26-4e82-92e1-d9f2e609b3cd tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:48.957870 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8bfef3e9-3e26-4e82-92e1-d9f2e609b3cd tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:49.027311 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-8bfef3e9-3e26-4e82-92e1-d9f2e609b3cd tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:49.035248 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-664e0ff8-3460-41f9-b0fc-322091bbf128 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:49.035798 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8bfef3e9-3e26-4e82-92e1-d9f2e609b3cd tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 200 len: 1218 microversion: 2.1 time: 0.085170 Sep 04 16:16:49.036384 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 229/451] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:48 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:49.041053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f053de7a-73a8-4566-b4e7-b7aebcc2507c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:49.043184 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f053de7a-73a8-4566-b4e7-b7aebcc2507c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:49.049856 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f053de7a-73a8-4566-b4e7-b7aebcc2507c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:49.050572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f053de7a-73a8-4566-b4e7-b7aebcc2507c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:49.051089 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f053de7a-73a8-4566-b4e7-b7aebcc2507c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:49.051971 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f053de7a-73a8-4566-b4e7-b7aebcc2507c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:49.052639 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f053de7a-73a8-4566-b4e7-b7aebcc2507c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:49.053265 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f053de7a-73a8-4566-b4e7-b7aebcc2507c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:49.054038 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-664e0ff8-3460-41f9-b0fc-322091bbf128 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:49.055670 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-664e0ff8-3460-41f9-b0fc-322091bbf128 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:49.057006 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-664e0ff8-3460-41f9-b0fc-322091bbf128 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1752 microversion: 2.20 time: 0.248091 Sep 04 16:16:49.057588 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 223/452] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:48 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1752 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:49.191029 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f053de7a-73a8-4566-b4e7-b7aebcc2507c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:49.198941 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f053de7a-73a8-4566-b4e7-b7aebcc2507c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1370 microversion: 2.1 time: 0.161534 Sep 04 16:16:49.199499 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 230/453] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:49 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:49.489369 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-dfa33dde-3dd9-4790-a351-ec737ffa0095 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:49.490099 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-dfa33dde-3dd9-4790-a351-ec737ffa0095 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:49.493762 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:16:49.497326 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dfa33dde-3dd9-4790-a351-ec737ffa0095 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:49.497848 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dfa33dde-3dd9-4790-a351-ec737ffa0095 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:49.498276 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dfa33dde-3dd9-4790-a351-ec737ffa0095 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:49.498966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dfa33dde-3dd9-4790-a351-ec737ffa0095 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:49.499414 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dfa33dde-3dd9-4790-a351-ec737ffa0095 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:49.500019 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dfa33dde-3dd9-4790-a351-ec737ffa0095 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:49.641231 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-dfa33dde-3dd9-4790-a351-ec737ffa0095 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:49.649913 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-dfa33dde-3dd9-4790-a351-ec737ffa0095 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1267 microversion: 2.1 time: 0.164883 Sep 04 16:16:49.650828 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 224/454] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:49 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:49.711886 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7bbe01af-6f55-4bc8-a30c-dc04313383db tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:49.712686 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7bbe01af-6f55-4bc8-a30c-dc04313383db tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:49.719230 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7bbe01af-6f55-4bc8-a30c-dc04313383db tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:49.719706 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7bbe01af-6f55-4bc8-a30c-dc04313383db tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:49.720175 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7bbe01af-6f55-4bc8-a30c-dc04313383db tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:49.721591 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7bbe01af-6f55-4bc8-a30c-dc04313383db tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:49.722102 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7bbe01af-6f55-4bc8-a30c-dc04313383db tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:49.732287 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7bbe01af-6f55-4bc8-a30c-dc04313383db tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:49.909914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8a59c2f7-d858-433c-ba8c-a2842a5f640f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:49.910605 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8a59c2f7-d858-433c-ba8c-a2842a5f640f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:49.917435 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8a59c2f7-d858-433c-ba8c-a2842a5f640f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:49.918004 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8a59c2f7-d858-433c-ba8c-a2842a5f640f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:49.918461 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8a59c2f7-d858-433c-ba8c-a2842a5f640f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:49.919127 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8a59c2f7-d858-433c-ba8c-a2842a5f640f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:49.919573 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8a59c2f7-d858-433c-ba8c-a2842a5f640f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:49.919989 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8a59c2f7-d858-433c-ba8c-a2842a5f640f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:49.942703 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:16:50.095504 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7bbe01af-6f55-4bc8-a30c-dc04313383db tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:50.116227 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7bbe01af-6f55-4bc8-a30c-dc04313383db tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1261 microversion: 2.1 time: 0.408186 Sep 04 16:16:50.117615 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 231/455] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:49 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1261 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:50.123118 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9b08fffc-3e6e-4d5b-9af8-0367b2eb4937 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:50.124176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9b08fffc-3e6e-4d5b-9af8-0367b2eb4937 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:50.133538 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b08fffc-3e6e-4d5b-9af8-0367b2eb4937 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:50.134391 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b08fffc-3e6e-4d5b-9af8-0367b2eb4937 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:50.134973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b08fffc-3e6e-4d5b-9af8-0367b2eb4937 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:50.136266 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b08fffc-3e6e-4d5b-9af8-0367b2eb4937 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:50.136865 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b08fffc-3e6e-4d5b-9af8-0367b2eb4937 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:50.137457 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b08fffc-3e6e-4d5b-9af8-0367b2eb4937 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:50.226721 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-9b08fffc-3e6e-4d5b-9af8-0367b2eb4937 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:50.233374 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8a59c2f7-d858-433c-ba8c-a2842a5f640f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:50.235653 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9b08fffc-3e6e-4d5b-9af8-0367b2eb4937 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 200 len: 1214 microversion: 2.1 time: 0.116951 Sep 04 16:16:50.236230 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 232/456] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:50 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 1214 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:50.240749 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cf1cc8a7-4201-4334-8730-1affdf718c4e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:50.241334 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cf1cc8a7-4201-4334-8730-1affdf718c4e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:50.247180 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf1cc8a7-4201-4334-8730-1affdf718c4e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:50.247659 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf1cc8a7-4201-4334-8730-1affdf718c4e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:50.248130 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf1cc8a7-4201-4334-8730-1affdf718c4e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:50.248834 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf1cc8a7-4201-4334-8730-1affdf718c4e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:50.249312 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf1cc8a7-4201-4334-8730-1affdf718c4e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:50.249754 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf1cc8a7-4201-4334-8730-1affdf718c4e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:50.257239 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8a59c2f7-d858-433c-ba8c-a2842a5f640f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1368 microversion: 2.1 time: 0.351722 Sep 04 16:16:50.257857 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 225/457] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:49 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1368 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:50.270826 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0dd95fc5-5371-44f9-84aa-6e9f36e7a985 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:50.270826 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0dd95fc5-5371-44f9-84aa-6e9f36e7a985 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:50.270826 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0dd95fc5-5371-44f9-84aa-6e9f36e7a985 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:50.271123 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0dd95fc5-5371-44f9-84aa-6e9f36e7a985 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:50.271440 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0dd95fc5-5371-44f9-84aa-6e9f36e7a985 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:50.272381 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0dd95fc5-5371-44f9-84aa-6e9f36e7a985 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:50.272582 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0dd95fc5-5371-44f9-84aa-6e9f36e7a985 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:50.273027 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0dd95fc5-5371-44f9-84aa-6e9f36e7a985 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:50.457730 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-cf1cc8a7-4201-4334-8730-1affdf718c4e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:50.464905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0dd95fc5-5371-44f9-84aa-6e9f36e7a985 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:50.467378 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-cf1cc8a7-4201-4334-8730-1affdf718c4e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:50.468820 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-cf1cc8a7-4201-4334-8730-1affdf718c4e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:50.470019 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cf1cc8a7-4201-4334-8730-1affdf718c4e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1752 microversion: 2.20 time: 0.232816 Sep 04 16:16:50.470678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 233/458] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:50 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1752 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:50.476011 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0dd95fc5-5371-44f9-84aa-6e9f36e7a985 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1370 microversion: 2.1 time: 0.217114 Sep 04 16:16:50.476993 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 226/459] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:50 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1370 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:50.672134 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a74a6c96-c628-46fc-af08-2ad9f275d400 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:50.672741 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a74a6c96-c628-46fc-af08-2ad9f275d400 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:50.680404 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a74a6c96-c628-46fc-af08-2ad9f275d400 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:50.680982 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a74a6c96-c628-46fc-af08-2ad9f275d400 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:50.681421 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a74a6c96-c628-46fc-af08-2ad9f275d400 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:50.682147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a74a6c96-c628-46fc-af08-2ad9f275d400 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:50.682662 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a74a6c96-c628-46fc-af08-2ad9f275d400 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:50.683090 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a74a6c96-c628-46fc-af08-2ad9f275d400 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:50.821342 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a74a6c96-c628-46fc-af08-2ad9f275d400 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:50.829349 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a74a6c96-c628-46fc-af08-2ad9f275d400 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1267 microversion: 2.1 time: 0.160982 Sep 04 16:16:50.829943 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 234/460] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:50 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:50.961513 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-d74b00be-75e1-45fb-98ec-1086f4be8151 req-b7410299-de52-48a9-9f37-3d694336c594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25192300-f22a-4b50-b390-17236f961eb5", "name": "network-vif-unplugged", "status": "completed", "tag": "ea45359b-6df0-4bcb-9182-26e4cca9bdd6"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:16:50.972260 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-d74b00be-75e1-45fb-98ec-1086f4be8151 req-b7410299-de52-48a9-9f37-3d694336c594 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:50.972734 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-d74b00be-75e1-45fb-98ec-1086f4be8151 req-b7410299-de52-48a9-9f37-3d694336c594 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:50.973146 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-d74b00be-75e1-45fb-98ec-1086f4be8151 req-b7410299-de52-48a9-9f37-3d694336c594 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:50.985406 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.compute.server_external_events [req-d74b00be-75e1-45fb-98ec-1086f4be8151 req-b7410299-de52-48a9-9f37-3d694336c594 service nova] Unable to find a host for instance 25192300-f22a-4b50-b390-17236f961eb5. Dropping event network-vif-unplugged {{(pid=121041) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 04 16:16:50.986545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-d74b00be-75e1-45fb-98ec-1086f4be8151 req-b7410299-de52-48a9-9f37-3d694336c594 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028975 Sep 04 16:16:50.987499 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 227/461] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 04 16:16:51.152361 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3423a75d-dcc7-45cf-93dd-807cc054f625 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:51.153330 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3423a75d-dcc7-45cf-93dd-807cc054f625 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:51.168245 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3423a75d-dcc7-45cf-93dd-807cc054f625 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:51.168743 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3423a75d-dcc7-45cf-93dd-807cc054f625 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:51.169182 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3423a75d-dcc7-45cf-93dd-807cc054f625 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:51.170307 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3423a75d-dcc7-45cf-93dd-807cc054f625 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:51.170770 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3423a75d-dcc7-45cf-93dd-807cc054f625 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:51.171194 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3423a75d-dcc7-45cf-93dd-807cc054f625 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:51.258970 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-56b67ee6-f712-4d28-bbf6-ae17ce366889 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:51.259764 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-56b67ee6-f712-4d28-bbf6-ae17ce366889 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:51.266025 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-56b67ee6-f712-4d28-bbf6-ae17ce366889 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:51.266753 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-56b67ee6-f712-4d28-bbf6-ae17ce366889 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:51.267457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-56b67ee6-f712-4d28-bbf6-ae17ce366889 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:51.268545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-56b67ee6-f712-4d28-bbf6-ae17ce366889 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:51.269183 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-56b67ee6-f712-4d28-bbf6-ae17ce366889 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:51.270013 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-56b67ee6-f712-4d28-bbf6-ae17ce366889 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:51.329874 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-3423a75d-dcc7-45cf-93dd-807cc054f625 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:51.338267 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3423a75d-dcc7-45cf-93dd-807cc054f625 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1261 microversion: 2.1 time: 0.189867 Sep 04 16:16:51.338844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 235/462] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:51 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1261 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:51.343378 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6e172092-c4e5-4c2c-9c1b-17e03d39f7e8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:51.344474 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6e172092-c4e5-4c2c-9c1b-17e03d39f7e8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:51.347514 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-56b67ee6-f712-4d28-bbf6-ae17ce366889 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:51.351025 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e172092-c4e5-4c2c-9c1b-17e03d39f7e8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:51.351715 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e172092-c4e5-4c2c-9c1b-17e03d39f7e8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:51.352150 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e172092-c4e5-4c2c-9c1b-17e03d39f7e8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:51.352841 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e172092-c4e5-4c2c-9c1b-17e03d39f7e8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:51.353293 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e172092-c4e5-4c2c-9c1b-17e03d39f7e8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:51.353749 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e172092-c4e5-4c2c-9c1b-17e03d39f7e8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:51.355922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-56b67ee6-f712-4d28-bbf6-ae17ce366889 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 200 len: 1270 microversion: 2.1 time: 0.100742 Sep 04 16:16:51.356694 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 228/463] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:51 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:51.488209 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-6e172092-c4e5-4c2c-9c1b-17e03d39f7e8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:51.496431 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6e172092-c4e5-4c2c-9c1b-17e03d39f7e8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1368 microversion: 2.1 time: 0.156565 Sep 04 16:16:51.505789 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 236/464] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:51 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:51.505986 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ba499eb3-30ac-40c0-b183-b5bc62df7716 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:51.505986 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ba499eb3-30ac-40c0-b183-b5bc62df7716 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:51.508785 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba499eb3-30ac-40c0-b183-b5bc62df7716 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:51.509522 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba499eb3-30ac-40c0-b183-b5bc62df7716 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:51.510620 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba499eb3-30ac-40c0-b183-b5bc62df7716 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:51.511544 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba499eb3-30ac-40c0-b183-b5bc62df7716 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:51.511996 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba499eb3-30ac-40c0-b183-b5bc62df7716 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:51.512419 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba499eb3-30ac-40c0-b183-b5bc62df7716 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:51.516140 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-12726b1b-728f-40db-9e92-52ea57ec4caf tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:51.516802 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-12726b1b-728f-40db-9e92-52ea57ec4caf tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:51.524999 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12726b1b-728f-40db-9e92-52ea57ec4caf tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:51.525478 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12726b1b-728f-40db-9e92-52ea57ec4caf tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:51.525933 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12726b1b-728f-40db-9e92-52ea57ec4caf tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:51.526627 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12726b1b-728f-40db-9e92-52ea57ec4caf tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:51.527076 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12726b1b-728f-40db-9e92-52ea57ec4caf tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:51.527644 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-12726b1b-728f-40db-9e92-52ea57ec4caf tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:51.722826 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ba499eb3-30ac-40c0-b183-b5bc62df7716 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:51.726218 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-12726b1b-728f-40db-9e92-52ea57ec4caf tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:51.735817 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-12726b1b-728f-40db-9e92-52ea57ec4caf tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1370 microversion: 2.1 time: 0.224784 Sep 04 16:16:51.737633 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 237/465] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:51 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1370 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:51.738424 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ba499eb3-30ac-40c0-b183-b5bc62df7716 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:51.739882 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ba499eb3-30ac-40c0-b183-b5bc62df7716 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:51.741047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ba499eb3-30ac-40c0-b183-b5bc62df7716 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1752 microversion: 2.20 time: 0.242718 Sep 04 16:16:51.741605 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 229/466] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:51 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1752 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:51.853240 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c4688a60-d9bb-4a8c-8edb-3a9a368b8c1c tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:51.853881 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c4688a60-d9bb-4a8c-8edb-3a9a368b8c1c tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:51.860300 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4688a60-d9bb-4a8c-8edb-3a9a368b8c1c tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:51.860776 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4688a60-d9bb-4a8c-8edb-3a9a368b8c1c tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:51.861417 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4688a60-d9bb-4a8c-8edb-3a9a368b8c1c tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:51.862242 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4688a60-d9bb-4a8c-8edb-3a9a368b8c1c tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:51.862693 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4688a60-d9bb-4a8c-8edb-3a9a368b8c1c tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:51.863104 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4688a60-d9bb-4a8c-8edb-3a9a368b8c1c tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:51.996820 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c4688a60-d9bb-4a8c-8edb-3a9a368b8c1c tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:52.005879 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c4688a60-d9bb-4a8c-8edb-3a9a368b8c1c tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1267 microversion: 2.1 time: 0.156513 Sep 04 16:16:52.006706 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 238/467] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:51 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:52.360901 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b686acd7-3cd1-483f-a3fd-758e01e37b70 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:52.361548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b686acd7-3cd1-483f-a3fd-758e01e37b70 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:52.367945 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b686acd7-3cd1-483f-a3fd-758e01e37b70 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:52.368410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b686acd7-3cd1-483f-a3fd-758e01e37b70 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:52.369011 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b686acd7-3cd1-483f-a3fd-758e01e37b70 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:52.369877 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b686acd7-3cd1-483f-a3fd-758e01e37b70 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:52.370321 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b686acd7-3cd1-483f-a3fd-758e01e37b70 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:52.370894 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b686acd7-3cd1-483f-a3fd-758e01e37b70 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:52.380379 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0f027de2-f28e-4c58-89da-d553d98e91b1 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:52.380997 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0f027de2-f28e-4c58-89da-d553d98e91b1 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:52.388289 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f027de2-f28e-4c58-89da-d553d98e91b1 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:52.389142 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f027de2-f28e-4c58-89da-d553d98e91b1 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:52.389763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f027de2-f28e-4c58-89da-d553d98e91b1 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:52.390688 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f027de2-f28e-4c58-89da-d553d98e91b1 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:52.391194 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f027de2-f28e-4c58-89da-d553d98e91b1 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:52.391613 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0f027de2-f28e-4c58-89da-d553d98e91b1 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:52.494606 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0f027de2-f28e-4c58-89da-d553d98e91b1 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:52.502867 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0f027de2-f28e-4c58-89da-d553d98e91b1 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 200 len: 1278 microversion: 2.1 time: 0.127458 Sep 04 16:16:52.503447 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 239/468] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:52 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 1278 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:52.523462 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-37e378b9-829e-44a0-a4fb-b9008df0fec0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:52.524080 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-37e378b9-829e-44a0-a4fb-b9008df0fec0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:52.530178 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37e378b9-829e-44a0-a4fb-b9008df0fec0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:52.530655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37e378b9-829e-44a0-a4fb-b9008df0fec0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:52.531082 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37e378b9-829e-44a0-a4fb-b9008df0fec0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:52.531908 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37e378b9-829e-44a0-a4fb-b9008df0fec0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:52.532386 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37e378b9-829e-44a0-a4fb-b9008df0fec0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:52.532808 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37e378b9-829e-44a0-a4fb-b9008df0fec0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:52.567380 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b686acd7-3cd1-483f-a3fd-758e01e37b70 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:52.577303 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b686acd7-3cd1-483f-a3fd-758e01e37b70 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1261 microversion: 2.1 time: 0.220493 Sep 04 16:16:52.578105 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 230/469] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:52 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1261 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:52.677132 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-37e378b9-829e-44a0-a4fb-b9008df0fec0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:52.684771 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-37e378b9-829e-44a0-a4fb-b9008df0fec0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1559 microversion: 2.1 time: 0.165688 Sep 04 16:16:52.685543 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 240/470] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:52 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:52.710041 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8cd3b5b4-4f39-4a77-bc6f-66093aedce25 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:52.710780 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8cd3b5b4-4f39-4a77-bc6f-66093aedce25 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:52.718208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8cd3b5b4-4f39-4a77-bc6f-66093aedce25 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:52.718694 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8cd3b5b4-4f39-4a77-bc6f-66093aedce25 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:52.719127 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8cd3b5b4-4f39-4a77-bc6f-66093aedce25 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:52.719822 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8cd3b5b4-4f39-4a77-bc6f-66093aedce25 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:52.720278 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8cd3b5b4-4f39-4a77-bc6f-66093aedce25 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:52.720870 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8cd3b5b4-4f39-4a77-bc6f-66093aedce25 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:52.766519 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fdf08eed-98e6-4552-833c-23ec78db7082 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:52.767139 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fdf08eed-98e6-4552-833c-23ec78db7082 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:52.774216 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdf08eed-98e6-4552-833c-23ec78db7082 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:52.774700 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdf08eed-98e6-4552-833c-23ec78db7082 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:52.775330 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdf08eed-98e6-4552-833c-23ec78db7082 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:52.776027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdf08eed-98e6-4552-833c-23ec78db7082 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:52.776481 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdf08eed-98e6-4552-833c-23ec78db7082 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:52.779445 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdf08eed-98e6-4552-833c-23ec78db7082 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:52.808569 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8cd3b5b4-4f39-4a77-bc6f-66093aedce25 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101498 Sep 04 16:16:52.808569 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 231/471] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Sep 4 16:16:52 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:16:52.818032 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-dca99bbf-eace-4a66-98e8-8ec6a9fefd55 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:52.818900 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-dca99bbf-eace-4a66-98e8-8ec6a9fefd55 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:52.826083 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dca99bbf-eace-4a66-98e8-8ec6a9fefd55 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:52.826705 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dca99bbf-eace-4a66-98e8-8ec6a9fefd55 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:52.827200 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dca99bbf-eace-4a66-98e8-8ec6a9fefd55 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:52.827965 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dca99bbf-eace-4a66-98e8-8ec6a9fefd55 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:52.828490 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dca99bbf-eace-4a66-98e8-8ec6a9fefd55 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:52.828967 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dca99bbf-eace-4a66-98e8-8ec6a9fefd55 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:53.005842 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-fdf08eed-98e6-4552-833c-23ec78db7082 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:53.016693 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fdf08eed-98e6-4552-833c-23ec78db7082 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1370 microversion: 2.1 time: 0.259736 Sep 04 16:16:53.026156 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 241/472] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:52 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1370 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:53.028811 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-dca99bbf-eace-4a66-98e8-8ec6a9fefd55 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:53.039074 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-dca99bbf-eace-4a66-98e8-8ec6a9fefd55 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:53.040628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-dca99bbf-eace-4a66-98e8-8ec6a9fefd55 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:53.042042 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-dca99bbf-eace-4a66-98e8-8ec6a9fefd55 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.227893 Sep 04 16:16:53.045140 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 232/473] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:52 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:53.048397 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fa671351-9f74-448e-bc91-ed067cb6e884 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:53.049978 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fa671351-9f74-448e-bc91-ed067cb6e884 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:53.058453 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa671351-9f74-448e-bc91-ed067cb6e884 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:53.059139 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa671351-9f74-448e-bc91-ed067cb6e884 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:53.059883 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa671351-9f74-448e-bc91-ed067cb6e884 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:53.061043 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa671351-9f74-448e-bc91-ed067cb6e884 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:53.061765 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa671351-9f74-448e-bc91-ed067cb6e884 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:53.062529 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa671351-9f74-448e-bc91-ed067cb6e884 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:53.325941 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-fa671351-9f74-448e-bc91-ed067cb6e884 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:53.336951 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fa671351-9f74-448e-bc91-ed067cb6e884 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1267 microversion: 2.1 time: 0.310185 Sep 04 16:16:53.337494 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 242/474] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:53 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1267 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:53.527299 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e2eaa0ba-14e6-4337-b292-343b747485f3 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:53.528554 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e2eaa0ba-14e6-4337-b292-343b747485f3 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:53.541293 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e2eaa0ba-14e6-4337-b292-343b747485f3 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:53.542361 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e2eaa0ba-14e6-4337-b292-343b747485f3 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:53.547473 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e2eaa0ba-14e6-4337-b292-343b747485f3 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:53.548618 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e2eaa0ba-14e6-4337-b292-343b747485f3 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:53.549385 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e2eaa0ba-14e6-4337-b292-343b747485f3 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:53.550071 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e2eaa0ba-14e6-4337-b292-343b747485f3 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:53.601292 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4ad10120-ebcc-4899-95ba-a71311528f4e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:53.602321 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4ad10120-ebcc-4899-95ba-a71311528f4e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:53.610446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ad10120-ebcc-4899-95ba-a71311528f4e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:53.611613 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ad10120-ebcc-4899-95ba-a71311528f4e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:53.612249 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ad10120-ebcc-4899-95ba-a71311528f4e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:53.613208 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ad10120-ebcc-4899-95ba-a71311528f4e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:53.614005 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ad10120-ebcc-4899-95ba-a71311528f4e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:53.614606 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ad10120-ebcc-4899-95ba-a71311528f4e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:53.644964 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e2eaa0ba-14e6-4337-b292-343b747485f3 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:53.668490 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e2eaa0ba-14e6-4337-b292-343b747485f3 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 200 len: 1288 microversion: 2.1 time: 0.145497 Sep 04 16:16:53.671522 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 233/475] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:53 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 1288 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:53.822706 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4ad10120-ebcc-4899-95ba-a71311528f4e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:53.831157 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4ad10120-ebcc-4899-95ba-a71311528f4e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1261 microversion: 2.1 time: 0.234563 Sep 04 16:16:53.831763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 243/476] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:53 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1261 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:54.044693 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7cba657c-26f6-495a-864b-d7a93b165df1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:54.045612 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7cba657c-26f6-495a-864b-d7a93b165df1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:54.052693 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7cba657c-26f6-495a-864b-d7a93b165df1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:54.053513 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7cba657c-26f6-495a-864b-d7a93b165df1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:54.058405 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7cba657c-26f6-495a-864b-d7a93b165df1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:54.058405 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7cba657c-26f6-495a-864b-d7a93b165df1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:54.058405 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7cba657c-26f6-495a-864b-d7a93b165df1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:54.058405 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7cba657c-26f6-495a-864b-d7a93b165df1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:54.072262 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1f77c405-6292-458e-b4ea-bd188969743a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:54.075157 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1f77c405-6292-458e-b4ea-bd188969743a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:54.095017 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f77c405-6292-458e-b4ea-bd188969743a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:54.095979 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f77c405-6292-458e-b4ea-bd188969743a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:54.096724 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f77c405-6292-458e-b4ea-bd188969743a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:54.098509 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f77c405-6292-458e-b4ea-bd188969743a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:54.099205 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f77c405-6292-458e-b4ea-bd188969743a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:54.099892 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f77c405-6292-458e-b4ea-bd188969743a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:54.609448 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7cba657c-26f6-495a-864b-d7a93b165df1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:54.614682 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1f77c405-6292-458e-b4ea-bd188969743a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:54.620415 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7cba657c-26f6-495a-864b-d7a93b165df1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1370 microversion: 2.1 time: 0.579493 Sep 04 16:16:54.621715 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 234/477] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:54 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1370 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:54.629365 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-01e26469-12ce-41d3-ba67-ebcdcbc277ae req-d58fec36-10b1-461b-bb16-7f5da4f22b26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "512e46e1-9291-44b3-b609-c1147f105f76", "tag": "08dc8012-7cf0-4bba-b537-c92a01bb802d"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:16:54.641758 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-01e26469-12ce-41d3-ba67-ebcdcbc277ae req-d58fec36-10b1-461b-bb16-7f5da4f22b26 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:54.652667 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1f77c405-6292-458e-b4ea-bd188969743a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:54.655591 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1f77c405-6292-458e-b4ea-bd188969743a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:54.656557 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-01e26469-12ce-41d3-ba67-ebcdcbc277ae req-d58fec36-10b1-461b-bb16-7f5da4f22b26 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:54.657189 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1f77c405-6292-458e-b4ea-bd188969743a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.589329 Sep 04 16:16:54.657330 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-01e26469-12ce-41d3-ba67-ebcdcbc277ae req-d58fec36-10b1-461b-bb16-7f5da4f22b26 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:54.658591 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 244/478] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:54 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:16:54.677706 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4090f44e-a8e9-48c4-b4d8-ad4053995584 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:54.678825 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4090f44e-a8e9-48c4-b4d8-ad4053995584 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:54.703084 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4090f44e-a8e9-48c4-b4d8-ad4053995584 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:54.704485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4090f44e-a8e9-48c4-b4d8-ad4053995584 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:54.704997 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4090f44e-a8e9-48c4-b4d8-ad4053995584 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:54.705947 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-01e26469-12ce-41d3-ba67-ebcdcbc277ae req-d58fec36-10b1-461b-bb16-7f5da4f22b26 service nova] Creating event network-changed:08dc8012-7cf0-4bba-b537-c92a01bb802d for instance 512e46e1-9291-44b3-b609-c1147f105f76 on hv-cinder-85236 Sep 04 16:16:54.710026 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4090f44e-a8e9-48c4-b4d8-ad4053995584 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:54.710510 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4090f44e-a8e9-48c4-b4d8-ad4053995584 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:54.711409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4090f44e-a8e9-48c4-b4d8-ad4053995584 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:54.721836 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:16:54.730209 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-01e26469-12ce-41d3-ba67-ebcdcbc277ae req-d58fec36-10b1-461b-bb16-7f5da4f22b26 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106118 Sep 04 16:16:54.731138 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 235/479] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:16:54.743084 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-97be08ec-8399-44c2-bbb3-322b15aeb886 req-896f556c-8de9-4934-b1af-978af8ace3a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0188e4a8-e601-43da-b389-7e0a8410ae8d", "name": "network-vif-plugged", "status": "completed", "tag": "ab492967-90e3-4b09-b251-d08c6b91d22c"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:16:54.758083 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-97be08ec-8399-44c2-bbb3-322b15aeb886 req-896f556c-8de9-4934-b1af-978af8ace3a2 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:54.759610 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-97be08ec-8399-44c2-bbb3-322b15aeb886 req-896f556c-8de9-4934-b1af-978af8ace3a2 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:54.760415 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-97be08ec-8399-44c2-bbb3-322b15aeb886 req-896f556c-8de9-4934-b1af-978af8ace3a2 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:54.775902 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-97be08ec-8399-44c2-bbb3-322b15aeb886 req-896f556c-8de9-4934-b1af-978af8ace3a2 service nova] Creating event network-vif-plugged:ab492967-90e3-4b09-b251-d08c6b91d22c for instance 0188e4a8-e601-43da-b389-7e0a8410ae8d on hv-cinder-85236 Sep 04 16:16:54.782832 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-97be08ec-8399-44c2-bbb3-322b15aeb886 req-896f556c-8de9-4934-b1af-978af8ace3a2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049845 Sep 04 16:16:54.783829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 236/480] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:16:54.790701 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-88b29aa8-b49b-4f17-8678-f41acc142e33 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:54.791831 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-88b29aa8-b49b-4f17-8678-f41acc142e33 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:54.803301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-88b29aa8-b49b-4f17-8678-f41acc142e33 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:54.803301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-88b29aa8-b49b-4f17-8678-f41acc142e33 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:54.803301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-88b29aa8-b49b-4f17-8678-f41acc142e33 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:54.803932 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-88b29aa8-b49b-4f17-8678-f41acc142e33 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:54.804010 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-88b29aa8-b49b-4f17-8678-f41acc142e33 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:54.804612 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-88b29aa8-b49b-4f17-8678-f41acc142e33 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:54.938017 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-88b29aa8-b49b-4f17-8678-f41acc142e33 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:54.953776 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-88b29aa8-b49b-4f17-8678-f41acc142e33 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 200 len: 1276 microversion: 2.1 time: 0.168232 Sep 04 16:16:54.962303 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 237/481] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:54 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 1276 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:54.969639 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a71e8602-fd80-4350-a92a-d184f1a9db76 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:54.970582 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a71e8602-fd80-4350-a92a-d184f1a9db76 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:54.977516 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a71e8602-fd80-4350-a92a-d184f1a9db76 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:54.978111 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a71e8602-fd80-4350-a92a-d184f1a9db76 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:54.978618 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a71e8602-fd80-4350-a92a-d184f1a9db76 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:54.979433 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a71e8602-fd80-4350-a92a-d184f1a9db76 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:54.979966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a71e8602-fd80-4350-a92a-d184f1a9db76 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:54.980472 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a71e8602-fd80-4350-a92a-d184f1a9db76 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:55.256077 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4090f44e-a8e9-48c4-b4d8-ad4053995584 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:55.268091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4090f44e-a8e9-48c4-b4d8-ad4053995584 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1267 microversion: 2.1 time: 0.606505 Sep 04 16:16:55.282614 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 245/482] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:54 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1267 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:55.395054 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a71e8602-fd80-4350-a92a-d184f1a9db76 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:55.402850 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a71e8602-fd80-4350-a92a-d184f1a9db76 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1261 microversion: 2.1 time: 0.439160 Sep 04 16:16:55.406478 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 238/483] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:54 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1261 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:55.645141 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a9a4042e-aab8-4e0d-9408-1fa251e6b7f8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:55.645817 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a9a4042e-aab8-4e0d-9408-1fa251e6b7f8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:55.655872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9a4042e-aab8-4e0d-9408-1fa251e6b7f8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:55.655872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9a4042e-aab8-4e0d-9408-1fa251e6b7f8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:55.655872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9a4042e-aab8-4e0d-9408-1fa251e6b7f8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:55.655872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9a4042e-aab8-4e0d-9408-1fa251e6b7f8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:55.656199 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9a4042e-aab8-4e0d-9408-1fa251e6b7f8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:55.656199 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9a4042e-aab8-4e0d-9408-1fa251e6b7f8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:55.685862 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-537483b2-7ac4-445b-bb15-667ecfb815e9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:55.686569 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-537483b2-7ac4-445b-bb15-667ecfb815e9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:55.695829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-537483b2-7ac4-445b-bb15-667ecfb815e9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:55.696318 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-537483b2-7ac4-445b-bb15-667ecfb815e9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:55.696780 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-537483b2-7ac4-445b-bb15-667ecfb815e9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:55.697484 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-537483b2-7ac4-445b-bb15-667ecfb815e9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:55.697988 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-537483b2-7ac4-445b-bb15-667ecfb815e9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:55.698448 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-537483b2-7ac4-445b-bb15-667ecfb815e9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:56.130456 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a9a4042e-aab8-4e0d-9408-1fa251e6b7f8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:56.146854 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a9a4042e-aab8-4e0d-9408-1fa251e6b7f8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1370 microversion: 2.1 time: 0.505930 Sep 04 16:16:56.147442 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 246/484] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:55 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1370 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:56.163159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ef3ddc15-09c2-4eac-9496-8b59977bb7b4 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:56.164802 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ef3ddc15-09c2-4eac-9496-8b59977bb7b4 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:56.181238 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-537483b2-7ac4-445b-bb15-667ecfb815e9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:56.185820 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef3ddc15-09c2-4eac-9496-8b59977bb7b4 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:56.186322 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef3ddc15-09c2-4eac-9496-8b59977bb7b4 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:56.186761 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef3ddc15-09c2-4eac-9496-8b59977bb7b4 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:56.187473 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef3ddc15-09c2-4eac-9496-8b59977bb7b4 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:56.187935 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef3ddc15-09c2-4eac-9496-8b59977bb7b4 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:56.188358 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef3ddc15-09c2-4eac-9496-8b59977bb7b4 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:56.201084 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-537483b2-7ac4-445b-bb15-667ecfb815e9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:56.204203 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-537483b2-7ac4-445b-bb15-667ecfb815e9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:56.207141 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-537483b2-7ac4-445b-bb15-667ecfb815e9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.525506 Sep 04 16:16:56.209200 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 239/485] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:55 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:16:56.292705 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a3bd20fc-1aa9-4c5a-bab8-ff11f3a282a5 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:56.293296 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a3bd20fc-1aa9-4c5a-bab8-ff11f3a282a5 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:56.300163 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a3bd20fc-1aa9-4c5a-bab8-ff11f3a282a5 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:56.301012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a3bd20fc-1aa9-4c5a-bab8-ff11f3a282a5 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:56.301647 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a3bd20fc-1aa9-4c5a-bab8-ff11f3a282a5 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:56.302505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a3bd20fc-1aa9-4c5a-bab8-ff11f3a282a5 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:56.304237 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a3bd20fc-1aa9-4c5a-bab8-ff11f3a282a5 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:56.304914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a3bd20fc-1aa9-4c5a-bab8-ff11f3a282a5 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:56.706919 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ef3ddc15-09c2-4eac-9496-8b59977bb7b4 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:56.718763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ef3ddc15-09c2-4eac-9496-8b59977bb7b4 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 200 len: 1318 microversion: 2.1 time: 0.569998 Sep 04 16:16:56.719372 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 247/486] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:56 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 1318 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:56.737054 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eac872fc-e1e6-4b9d-8b03-a1a7b6b58e86 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:56.738088 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eac872fc-e1e6-4b9d-8b03-a1a7b6b58e86 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:56.754729 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eac872fc-e1e6-4b9d-8b03-a1a7b6b58e86 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:56.756413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eac872fc-e1e6-4b9d-8b03-a1a7b6b58e86 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:56.757003 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eac872fc-e1e6-4b9d-8b03-a1a7b6b58e86 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:56.758492 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eac872fc-e1e6-4b9d-8b03-a1a7b6b58e86 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:56.759100 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eac872fc-e1e6-4b9d-8b03-a1a7b6b58e86 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:56.759662 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eac872fc-e1e6-4b9d-8b03-a1a7b6b58e86 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:56.799376 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a3bd20fc-1aa9-4c5a-bab8-ff11f3a282a5 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:56.807829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a3bd20fc-1aa9-4c5a-bab8-ff11f3a282a5 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1267 microversion: 2.1 time: 0.518914 Sep 04 16:16:56.808643 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 240/487] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:56 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1267 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:57.176361 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ae3e023a-a2df-4389-9b05-f17d9fb092e5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:57.177354 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ae3e023a-a2df-4389-9b05-f17d9fb092e5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:57.184555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ae3e023a-a2df-4389-9b05-f17d9fb092e5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:57.185357 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ae3e023a-a2df-4389-9b05-f17d9fb092e5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:57.186153 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ae3e023a-a2df-4389-9b05-f17d9fb092e5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:57.187195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ae3e023a-a2df-4389-9b05-f17d9fb092e5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:57.187857 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ae3e023a-a2df-4389-9b05-f17d9fb092e5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:57.188718 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ae3e023a-a2df-4389-9b05-f17d9fb092e5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:57.346393 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-eac872fc-e1e6-4b9d-8b03-a1a7b6b58e86 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:57.358738 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eac872fc-e1e6-4b9d-8b03-a1a7b6b58e86 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1261 microversion: 2.1 time: 0.637745 Sep 04 16:16:57.359429 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 248/488] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:56 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1261 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:57.365459 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-74762876-3d8b-416e-8dab-6f1e3bd12d9f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:57.366946 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-74762876-3d8b-416e-8dab-6f1e3bd12d9f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:57.373395 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74762876-3d8b-416e-8dab-6f1e3bd12d9f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:57.373995 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74762876-3d8b-416e-8dab-6f1e3bd12d9f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:57.374626 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74762876-3d8b-416e-8dab-6f1e3bd12d9f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:57.375326 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74762876-3d8b-416e-8dab-6f1e3bd12d9f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:57.375964 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74762876-3d8b-416e-8dab-6f1e3bd12d9f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:57.376391 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-74762876-3d8b-416e-8dab-6f1e3bd12d9f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:57.547299 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ae3e023a-a2df-4389-9b05-f17d9fb092e5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:57.558333 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ae3e023a-a2df-4389-9b05-f17d9fb092e5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1370 microversion: 2.1 time: 0.388528 Sep 04 16:16:57.574099 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 241/489] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:57 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1370 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:16:57.651433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-74762876-3d8b-416e-8dab-6f1e3bd12d9f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:57.664353 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-74762876-3d8b-416e-8dab-6f1e3bd12d9f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:57.666148 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-74762876-3d8b-416e-8dab-6f1e3bd12d9f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:57.667517 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-74762876-3d8b-416e-8dab-6f1e3bd12d9f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.306909 Sep 04 16:16:57.668079 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 249/490] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:57 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:57.745745 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cf99ce01-076e-44d8-9c97-9214227759fe tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:57.746341 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cf99ce01-076e-44d8-9c97-9214227759fe tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:57.753428 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cf99ce01-076e-44d8-9c97-9214227759fe tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:57.753943 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cf99ce01-076e-44d8-9c97-9214227759fe tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:57.754456 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cf99ce01-076e-44d8-9c97-9214227759fe tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:57.755171 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cf99ce01-076e-44d8-9c97-9214227759fe tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:57.755633 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cf99ce01-076e-44d8-9c97-9214227759fe tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:57.756059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cf99ce01-076e-44d8-9c97-9214227759fe tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:57.809640 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-e0bfc96c-ee1d-4321-b8e3-a4c0e426dd81 req-e1c467e7-a458-4b86-8272-5cc1d53786f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef119005-1210-4108-b0bd-98771fe1fa37", "tag": "4f0626e3-395a-4b67-9d54-2a5ea157dccc"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:16:57.820351 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e0bfc96c-ee1d-4321-b8e3-a4c0e426dd81 req-e1c467e7-a458-4b86-8272-5cc1d53786f0 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:57.820820 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e0bfc96c-ee1d-4321-b8e3-a4c0e426dd81 req-e1c467e7-a458-4b86-8272-5cc1d53786f0 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:57.821241 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e0bfc96c-ee1d-4321-b8e3-a4c0e426dd81 req-e1c467e7-a458-4b86-8272-5cc1d53786f0 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:57.833012 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-e0bfc96c-ee1d-4321-b8e3-a4c0e426dd81 req-e1c467e7-a458-4b86-8272-5cc1d53786f0 service nova] Creating event network-changed:4f0626e3-395a-4b67-9d54-2a5ea157dccc for instance ef119005-1210-4108-b0bd-98771fe1fa37 on hv-cinder-85236 Sep 04 16:16:57.838552 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-e0bfc96c-ee1d-4321-b8e3-a4c0e426dd81 req-e1c467e7-a458-4b86-8272-5cc1d53786f0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032605 Sep 04 16:16:57.839142 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 250/491] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:16:57.844774 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aa9e444e-8d10-4616-9b24-ad22700dbbd2 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:57.846212 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aa9e444e-8d10-4616-9b24-ad22700dbbd2 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:57.853793 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa9e444e-8d10-4616-9b24-ad22700dbbd2 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:57.854501 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa9e444e-8d10-4616-9b24-ad22700dbbd2 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:57.854934 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa9e444e-8d10-4616-9b24-ad22700dbbd2 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:57.855876 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa9e444e-8d10-4616-9b24-ad22700dbbd2 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:57.856295 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa9e444e-8d10-4616-9b24-ad22700dbbd2 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:57.856841 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa9e444e-8d10-4616-9b24-ad22700dbbd2 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:58.002466 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-cf99ce01-076e-44d8-9c97-9214227759fe tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:58.012738 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cf99ce01-076e-44d8-9c97-9214227759fe tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 200 len: 1318 microversion: 2.1 time: 0.271141 Sep 04 16:16:58.017739 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 242/492] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:57 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:58.051315 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-aa9e444e-8d10-4616-9b24-ad22700dbbd2 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:58.077972 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aa9e444e-8d10-4616-9b24-ad22700dbbd2 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1267 microversion: 2.1 time: 0.222533 Sep 04 16:16:58.077972 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 251/493] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:57 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:58.384321 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-dfb949e9-55e3-425b-87f7-f11f46cf5e14 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:58.384918 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-dfb949e9-55e3-425b-87f7-f11f46cf5e14 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:58.391717 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dfb949e9-55e3-425b-87f7-f11f46cf5e14 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:58.392284 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dfb949e9-55e3-425b-87f7-f11f46cf5e14 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:58.392715 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dfb949e9-55e3-425b-87f7-f11f46cf5e14 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:58.393409 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dfb949e9-55e3-425b-87f7-f11f46cf5e14 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:58.393886 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dfb949e9-55e3-425b-87f7-f11f46cf5e14 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:58.394475 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dfb949e9-55e3-425b-87f7-f11f46cf5e14 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:58.557368 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-ddf65563-7af2-4f1a-addb-0a7b1bfc7cdc req-039c5103-a737-4e22-a3e1-4b3be1525486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84acd9f2-8732-4d8b-843e-46e2ccd5e5cc", "name": "network-vif-plugged", "status": "completed", "tag": "b7aa303d-deea-4135-89b8-303faf88bdfe"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:16:58.564729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:16:58.582142 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ddf65563-7af2-4f1a-addb-0a7b1bfc7cdc req-039c5103-a737-4e22-a3e1-4b3be1525486 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:58.582652 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ddf65563-7af2-4f1a-addb-0a7b1bfc7cdc req-039c5103-a737-4e22-a3e1-4b3be1525486 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:58.583083 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ddf65563-7af2-4f1a-addb-0a7b1bfc7cdc req-039c5103-a737-4e22-a3e1-4b3be1525486 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:58.600650 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-ddf65563-7af2-4f1a-addb-0a7b1bfc7cdc req-039c5103-a737-4e22-a3e1-4b3be1525486 service nova] Creating event network-vif-plugged:b7aa303d-deea-4135-89b8-303faf88bdfe for instance 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc on hv-cinder-85236 Sep 04 16:16:58.602383 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=6 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:16:58.611518 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-ddf65563-7af2-4f1a-addb-0a7b1bfc7cdc req-039c5103-a737-4e22-a3e1-4b3be1525486 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055004 Sep 04 16:16:58.611518 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 252/494] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:16:58.618572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-98d44374-077a-46e0-aa8c-6c3482943fcc tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:58.619897 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-98d44374-077a-46e0-aa8c-6c3482943fcc tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:58.629146 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98d44374-077a-46e0-aa8c-6c3482943fcc tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:58.630225 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98d44374-077a-46e0-aa8c-6c3482943fcc tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:58.634554 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98d44374-077a-46e0-aa8c-6c3482943fcc tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:58.634554 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98d44374-077a-46e0-aa8c-6c3482943fcc tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:58.634554 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98d44374-077a-46e0-aa8c-6c3482943fcc tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:58.634554 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-98d44374-077a-46e0-aa8c-6c3482943fcc tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:58.644417 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-dfb949e9-55e3-425b-87f7-f11f46cf5e14 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:58.655720 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-dfb949e9-55e3-425b-87f7-f11f46cf5e14 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1261 microversion: 2.1 time: 0.275113 Sep 04 16:16:58.657762 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 243/495] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:58 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1261 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:58.695776 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d9c87505-6016-4f7e-a583-a86dbe0a5a5c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:58.696917 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d9c87505-6016-4f7e-a583-a86dbe0a5a5c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:58.703288 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d9c87505-6016-4f7e-a583-a86dbe0a5a5c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:58.703809 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d9c87505-6016-4f7e-a583-a86dbe0a5a5c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:58.704247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d9c87505-6016-4f7e-a583-a86dbe0a5a5c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:58.705244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d9c87505-6016-4f7e-a583-a86dbe0a5a5c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:58.705751 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d9c87505-6016-4f7e-a583-a86dbe0a5a5c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:58.706296 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d9c87505-6016-4f7e-a583-a86dbe0a5a5c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:58.726725 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:16:58.909288 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-98d44374-077a-46e0-aa8c-6c3482943fcc tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:58.919513 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-98d44374-077a-46e0-aa8c-6c3482943fcc tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1563 microversion: 2.1 time: 0.308233 Sep 04 16:16:58.930393 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 253/496] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:58 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1563 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:58.965226 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-88794ad4-3736-45bd-8276-f067cd95ae80 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:58.966260 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-88794ad4-3736-45bd-8276-f067cd95ae80 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:58.969862 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:16:58.988540 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88794ad4-3736-45bd-8276-f067cd95ae80 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:58.989387 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88794ad4-3736-45bd-8276-f067cd95ae80 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:58.990091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88794ad4-3736-45bd-8276-f067cd95ae80 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:58.991085 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88794ad4-3736-45bd-8276-f067cd95ae80 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:58.991770 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88794ad4-3736-45bd-8276-f067cd95ae80 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:58.992426 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-88794ad4-3736-45bd-8276-f067cd95ae80 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:59.033992 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:16:59.055914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d9c87505-6016-4f7e-a583-a86dbe0a5a5c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:59.073272 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d9c87505-6016-4f7e-a583-a86dbe0a5a5c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:59.077008 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d9c87505-6016-4f7e-a583-a86dbe0a5a5c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:59.094464 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d9c87505-6016-4f7e-a583-a86dbe0a5a5c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.403886 Sep 04 16:16:59.096356 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 244/497] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:16:58 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:16:59.102470 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2bd092be-f8ce-4d74-89f9-b0bd740797ca tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:59.103259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2bd092be-f8ce-4d74-89f9-b0bd740797ca tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:59.115389 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2bd092be-f8ce-4d74-89f9-b0bd740797ca tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:59.122498 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2bd092be-f8ce-4d74-89f9-b0bd740797ca tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:59.124856 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2bd092be-f8ce-4d74-89f9-b0bd740797ca tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:59.124856 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2bd092be-f8ce-4d74-89f9-b0bd740797ca tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:59.124856 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2bd092be-f8ce-4d74-89f9-b0bd740797ca tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:59.124856 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2bd092be-f8ce-4d74-89f9-b0bd740797ca tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:59.346946 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-88794ad4-3736-45bd-8276-f067cd95ae80 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.388496 Sep 04 16:16:59.361812 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 254/498] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Sep 4 16:16:58 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d/os-interface => generated 284 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:16:59.367321 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d67827ed-070f-44f7-827c-acd48d272ee7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:59.372645 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d67827ed-070f-44f7-827c-acd48d272ee7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:59.396269 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d67827ed-070f-44f7-827c-acd48d272ee7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:59.399781 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d67827ed-070f-44f7-827c-acd48d272ee7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:59.400617 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d67827ed-070f-44f7-827c-acd48d272ee7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:59.401452 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d67827ed-070f-44f7-827c-acd48d272ee7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:59.404073 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d67827ed-070f-44f7-827c-acd48d272ee7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:59.404661 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d67827ed-070f-44f7-827c-acd48d272ee7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:59.674820 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2bd092be-f8ce-4d74-89f9-b0bd740797ca tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:59.687545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2bd092be-f8ce-4d74-89f9-b0bd740797ca tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 200 len: 1318 microversion: 2.1 time: 0.586241 Sep 04 16:16:59.689083 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 245/499] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:59 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 1318 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:16:59.709962 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-66bbea02-48aa-48a8-acc7-a1cc3c0887ab tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:16:59.710577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-66bbea02-48aa-48a8-acc7-a1cc3c0887ab tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:16:59.731952 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66bbea02-48aa-48a8-acc7-a1cc3c0887ab tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:59.732404 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66bbea02-48aa-48a8-acc7-a1cc3c0887ab tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:59.739066 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66bbea02-48aa-48a8-acc7-a1cc3c0887ab tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:59.740165 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66bbea02-48aa-48a8-acc7-a1cc3c0887ab tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:16:59.740377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66bbea02-48aa-48a8-acc7-a1cc3c0887ab tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:16:59.740774 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66bbea02-48aa-48a8-acc7-a1cc3c0887ab tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:16:59.829296 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d67827ed-070f-44f7-827c-acd48d272ee7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:16:59.840140 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d67827ed-070f-44f7-827c-acd48d272ee7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1267 microversion: 2.1 time: 0.475706 Sep 04 16:16:59.841063 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 255/500] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:59 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1267 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:00.058098 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-66bbea02-48aa-48a8-acc7-a1cc3c0887ab tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:00.067522 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-66bbea02-48aa-48a8-acc7-a1cc3c0887ab tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1261 microversion: 2.1 time: 0.372313 Sep 04 16:17:00.076130 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 246/501] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:16:59 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1261 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:00.127670 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6da999bc-9179-40d7-a6dc-9748897c03c0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:00.127670 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6da999bc-9179-40d7-a6dc-9748897c03c0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:00.132833 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6da999bc-9179-40d7-a6dc-9748897c03c0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:00.134084 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6da999bc-9179-40d7-a6dc-9748897c03c0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:00.134542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6da999bc-9179-40d7-a6dc-9748897c03c0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:00.135255 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6da999bc-9179-40d7-a6dc-9748897c03c0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:00.136235 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6da999bc-9179-40d7-a6dc-9748897c03c0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:00.136670 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6da999bc-9179-40d7-a6dc-9748897c03c0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:00.278457 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-6da999bc-9179-40d7-a6dc-9748897c03c0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:00.287340 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-6da999bc-9179-40d7-a6dc-9748897c03c0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:00.288772 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-6da999bc-9179-40d7-a6dc-9748897c03c0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:00.289951 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6da999bc-9179-40d7-a6dc-9748897c03c0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.169141 Sep 04 16:17:00.290510 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 256/502] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:17:00 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:17:00.650408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-4f24ae1c-7cf0-4cc2-a224-3670bdf0e1d3 req-99b1fa49-3565-49c6-9632-a23087deb6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d24964d-b2cb-420a-9232-b5662800ec31", "name": "network-vif-plugged", "status": "completed", "tag": "16088940-01d4-4b7c-9350-5157b311afa1"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:17:00.661364 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-4f24ae1c-7cf0-4cc2-a224-3670bdf0e1d3 req-99b1fa49-3565-49c6-9632-a23087deb6a1 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:00.661876 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-4f24ae1c-7cf0-4cc2-a224-3670bdf0e1d3 req-99b1fa49-3565-49c6-9632-a23087deb6a1 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:00.666085 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-4f24ae1c-7cf0-4cc2-a224-3670bdf0e1d3 req-99b1fa49-3565-49c6-9632-a23087deb6a1 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:00.674067 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-4f24ae1c-7cf0-4cc2-a224-3670bdf0e1d3 req-99b1fa49-3565-49c6-9632-a23087deb6a1 service nova] Creating event network-vif-plugged:16088940-01d4-4b7c-9350-5157b311afa1 for instance 5d24964d-b2cb-420a-9232-b5662800ec31 on hv-cinder-85236 Sep 04 16:17:00.680065 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-4f24ae1c-7cf0-4cc2-a224-3670bdf0e1d3 req-99b1fa49-3565-49c6-9632-a23087deb6a1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033664 Sep 04 16:17:00.680670 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 247/503] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:17:00.714344 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-36a1e876-4664-41f9-92fa-577b7b73cd31 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:00.714953 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-36a1e876-4664-41f9-92fa-577b7b73cd31 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:00.718924 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-89b6cb01-b0d2-40f6-8811-491e52c2da30 req-729c5606-dfd7-4fa4-8f0f-e8a321893a24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0188e4a8-e601-43da-b389-7e0a8410ae8d", "tag": "ab492967-90e3-4b09-b251-d08c6b91d22c"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:17:00.723618 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36a1e876-4664-41f9-92fa-577b7b73cd31 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:00.724425 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36a1e876-4664-41f9-92fa-577b7b73cd31 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:00.729209 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36a1e876-4664-41f9-92fa-577b7b73cd31 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:00.729209 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36a1e876-4664-41f9-92fa-577b7b73cd31 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:00.729209 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36a1e876-4664-41f9-92fa-577b7b73cd31 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:00.729209 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-36a1e876-4664-41f9-92fa-577b7b73cd31 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:00.729524 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-89b6cb01-b0d2-40f6-8811-491e52c2da30 req-729c5606-dfd7-4fa4-8f0f-e8a321893a24 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:00.729922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-89b6cb01-b0d2-40f6-8811-491e52c2da30 req-729c5606-dfd7-4fa4-8f0f-e8a321893a24 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:00.730531 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-89b6cb01-b0d2-40f6-8811-491e52c2da30 req-729c5606-dfd7-4fa4-8f0f-e8a321893a24 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:00.744630 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-89b6cb01-b0d2-40f6-8811-491e52c2da30 req-729c5606-dfd7-4fa4-8f0f-e8a321893a24 service nova] Creating event network-changed:ab492967-90e3-4b09-b251-d08c6b91d22c for instance 0188e4a8-e601-43da-b389-7e0a8410ae8d on hv-cinder-85236 Sep 04 16:17:00.750568 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-89b6cb01-b0d2-40f6-8811-491e52c2da30 req-729c5606-dfd7-4fa4-8f0f-e8a321893a24 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035577 Sep 04 16:17:00.751369 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 248/504] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:17:00.864667 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-10704504-6dc5-4162-ac0c-c9312b6a4aa3 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:00.865196 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-36a1e876-4664-41f9-92fa-577b7b73cd31 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:00.865853 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-10704504-6dc5-4162-ac0c-c9312b6a4aa3 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:00.872569 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10704504-6dc5-4162-ac0c-c9312b6a4aa3 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:00.873132 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10704504-6dc5-4162-ac0c-c9312b6a4aa3 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:00.873673 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10704504-6dc5-4162-ac0c-c9312b6a4aa3 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:00.874456 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10704504-6dc5-4162-ac0c-c9312b6a4aa3 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:00.875004 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10704504-6dc5-4162-ac0c-c9312b6a4aa3 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:00.875126 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-36a1e876-4664-41f9-92fa-577b7b73cd31 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 200 len: 1318 microversion: 2.1 time: 0.164360 Sep 04 16:17:00.875574 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10704504-6dc5-4162-ac0c-c9312b6a4aa3 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:00.876421 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 257/505] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:00 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:01.092834 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8d1447f7-8baf-4d68-ad9b-9dc2f9ed6f64 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:01.093681 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8d1447f7-8baf-4d68-ad9b-9dc2f9ed6f64 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:01.124592 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d1447f7-8baf-4d68-ad9b-9dc2f9ed6f64 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:01.125341 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d1447f7-8baf-4d68-ad9b-9dc2f9ed6f64 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:01.130979 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d1447f7-8baf-4d68-ad9b-9dc2f9ed6f64 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:01.131646 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-10704504-6dc5-4162-ac0c-c9312b6a4aa3 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:01.134569 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d1447f7-8baf-4d68-ad9b-9dc2f9ed6f64 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:01.140157 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d1447f7-8baf-4d68-ad9b-9dc2f9ed6f64 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:01.141021 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8d1447f7-8baf-4d68-ad9b-9dc2f9ed6f64 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:01.141372 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-10704504-6dc5-4162-ac0c-c9312b6a4aa3 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1267 microversion: 2.1 time: 0.281566 Sep 04 16:17:01.142581 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 249/506] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:00 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1267 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:17:01.316119 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a3adf9d6-beb5-46b0-8290-73ca0961d45a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:01.327174 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a3adf9d6-beb5-46b0-8290-73ca0961d45a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:01.341750 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a3adf9d6-beb5-46b0-8290-73ca0961d45a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:01.342584 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a3adf9d6-beb5-46b0-8290-73ca0961d45a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:01.343170 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a3adf9d6-beb5-46b0-8290-73ca0961d45a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:01.344181 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a3adf9d6-beb5-46b0-8290-73ca0961d45a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:01.344806 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a3adf9d6-beb5-46b0-8290-73ca0961d45a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:01.346019 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a3adf9d6-beb5-46b0-8290-73ca0961d45a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:01.381265 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-8d1447f7-8baf-4d68-ad9b-9dc2f9ed6f64 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:01.391008 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8d1447f7-8baf-4d68-ad9b-9dc2f9ed6f64 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1261 microversion: 2.1 time: 0.302702 Sep 04 16:17:01.392456 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 258/507] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:01 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1261 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:01.516690 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a3adf9d6-beb5-46b0-8290-73ca0961d45a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:01.526800 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a3adf9d6-beb5-46b0-8290-73ca0961d45a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:01.529962 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a3adf9d6-beb5-46b0-8290-73ca0961d45a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:01.529962 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a3adf9d6-beb5-46b0-8290-73ca0961d45a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.218019 Sep 04 16:17:01.546144 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 250/508] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:17:01 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:17:01.900307 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2e3868c0-84b0-43d0-89fc-83f3bbb3be1d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:01.900921 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2e3868c0-84b0-43d0-89fc-83f3bbb3be1d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:01.907836 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e3868c0-84b0-43d0-89fc-83f3bbb3be1d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:01.908760 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e3868c0-84b0-43d0-89fc-83f3bbb3be1d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:01.909197 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e3868c0-84b0-43d0-89fc-83f3bbb3be1d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:01.910344 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e3868c0-84b0-43d0-89fc-83f3bbb3be1d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:01.911047 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e3868c0-84b0-43d0-89fc-83f3bbb3be1d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:01.911478 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e3868c0-84b0-43d0-89fc-83f3bbb3be1d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:02.075615 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2e3868c0-84b0-43d0-89fc-83f3bbb3be1d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:02.104629 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2e3868c0-84b0-43d0-89fc-83f3bbb3be1d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 200 len: 1318 microversion: 2.1 time: 0.208048 Sep 04 16:17:02.107020 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 259/509] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:01 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:02.164242 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-70eb74ef-bb99-4ae0-ab30-0a98628db477 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:02.165465 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-70eb74ef-bb99-4ae0-ab30-0a98628db477 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:02.172845 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70eb74ef-bb99-4ae0-ab30-0a98628db477 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:02.173688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70eb74ef-bb99-4ae0-ab30-0a98628db477 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:02.174357 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70eb74ef-bb99-4ae0-ab30-0a98628db477 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:02.175289 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70eb74ef-bb99-4ae0-ab30-0a98628db477 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:02.175954 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70eb74ef-bb99-4ae0-ab30-0a98628db477 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:02.176828 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70eb74ef-bb99-4ae0-ab30-0a98628db477 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:02.339133 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-70eb74ef-bb99-4ae0-ab30-0a98628db477 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:02.348972 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-70eb74ef-bb99-4ae0-ab30-0a98628db477 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1267 microversion: 2.1 time: 0.188403 Sep 04 16:17:02.349677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 251/510] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:02 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:02.414986 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ad642bf2-60ac-4fb8-8ca1-381a9f13827a tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:02.415579 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ad642bf2-60ac-4fb8-8ca1-381a9f13827a tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:02.422139 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad642bf2-60ac-4fb8-8ca1-381a9f13827a tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:02.422626 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad642bf2-60ac-4fb8-8ca1-381a9f13827a tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:02.423056 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad642bf2-60ac-4fb8-8ca1-381a9f13827a tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:02.423877 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad642bf2-60ac-4fb8-8ca1-381a9f13827a tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:02.424537 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad642bf2-60ac-4fb8-8ca1-381a9f13827a tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:02.424965 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ad642bf2-60ac-4fb8-8ca1-381a9f13827a tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:02.556656 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-14e4098c-ef0c-4908-a7dc-427a0466eee5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:02.557655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-14e4098c-ef0c-4908-a7dc-427a0466eee5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:02.565127 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-14e4098c-ef0c-4908-a7dc-427a0466eee5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:02.565924 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-14e4098c-ef0c-4908-a7dc-427a0466eee5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:02.567363 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-14e4098c-ef0c-4908-a7dc-427a0466eee5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:02.568643 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-14e4098c-ef0c-4908-a7dc-427a0466eee5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:02.569583 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-14e4098c-ef0c-4908-a7dc-427a0466eee5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:02.570263 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-14e4098c-ef0c-4908-a7dc-427a0466eee5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:02.574871 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ad642bf2-60ac-4fb8-8ca1-381a9f13827a tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:02.586076 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ad642bf2-60ac-4fb8-8ca1-381a9f13827a tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1261 microversion: 2.1 time: 0.174733 Sep 04 16:17:02.586841 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 260/511] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:02 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1261 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:02.726543 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-14e4098c-ef0c-4908-a7dc-427a0466eee5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:02.735277 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-14e4098c-ef0c-4908-a7dc-427a0466eee5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:02.737464 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-14e4098c-ef0c-4908-a7dc-427a0466eee5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:02.738675 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-14e4098c-ef0c-4908-a7dc-427a0466eee5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.186113 Sep 04 16:17:02.739536 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 252/512] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:17:02 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:17:03.138297 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0b8cb4e0-ba4a-4a25-83c4-a78539a00aa5 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:03.139284 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0b8cb4e0-ba4a-4a25-83c4-a78539a00aa5 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:03.147858 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b8cb4e0-ba4a-4a25-83c4-a78539a00aa5 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:03.148737 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b8cb4e0-ba4a-4a25-83c4-a78539a00aa5 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:03.149522 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b8cb4e0-ba4a-4a25-83c4-a78539a00aa5 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:03.150707 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b8cb4e0-ba4a-4a25-83c4-a78539a00aa5 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:03.152355 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b8cb4e0-ba4a-4a25-83c4-a78539a00aa5 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:03.152797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0b8cb4e0-ba4a-4a25-83c4-a78539a00aa5 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:03.307377 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0b8cb4e0-ba4a-4a25-83c4-a78539a00aa5 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:03.318650 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0b8cb4e0-ba4a-4a25-83c4-a78539a00aa5 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 200 len: 1318 microversion: 2.1 time: 0.184458 Sep 04 16:17:03.328710 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 261/513] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:03 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:03.373656 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8f5d135c-1a61-4cd2-90c5-9ea5aee2400f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:03.374266 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8f5d135c-1a61-4cd2-90c5-9ea5aee2400f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:03.382519 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8f5d135c-1a61-4cd2-90c5-9ea5aee2400f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:03.383008 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8f5d135c-1a61-4cd2-90c5-9ea5aee2400f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:03.383436 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8f5d135c-1a61-4cd2-90c5-9ea5aee2400f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:03.384124 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8f5d135c-1a61-4cd2-90c5-9ea5aee2400f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:03.384760 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8f5d135c-1a61-4cd2-90c5-9ea5aee2400f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:03.385178 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8f5d135c-1a61-4cd2-90c5-9ea5aee2400f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:03.526552 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8f5d135c-1a61-4cd2-90c5-9ea5aee2400f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:03.548268 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8f5d135c-1a61-4cd2-90c5-9ea5aee2400f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1267 microversion: 2.1 time: 0.178771 Sep 04 16:17:03.553421 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 253/514] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:03 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:03.615558 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3a0ecc92-e2e5-4b74-9894-cb0e46837d38 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:03.617120 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3a0ecc92-e2e5-4b74-9894-cb0e46837d38 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:03.624278 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a0ecc92-e2e5-4b74-9894-cb0e46837d38 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:03.625167 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a0ecc92-e2e5-4b74-9894-cb0e46837d38 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:03.625627 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a0ecc92-e2e5-4b74-9894-cb0e46837d38 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:03.626502 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a0ecc92-e2e5-4b74-9894-cb0e46837d38 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:03.627110 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a0ecc92-e2e5-4b74-9894-cb0e46837d38 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:03.629959 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a0ecc92-e2e5-4b74-9894-cb0e46837d38 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:03.764427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3230e613-8e0c-4dbc-82af-38f5a64af6d3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:03.765032 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3230e613-8e0c-4dbc-82af-38f5a64af6d3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:03.772100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3230e613-8e0c-4dbc-82af-38f5a64af6d3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:03.772587 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3230e613-8e0c-4dbc-82af-38f5a64af6d3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:03.773058 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3230e613-8e0c-4dbc-82af-38f5a64af6d3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:03.773948 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3230e613-8e0c-4dbc-82af-38f5a64af6d3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:03.774345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3230e613-8e0c-4dbc-82af-38f5a64af6d3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:03.774767 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3230e613-8e0c-4dbc-82af-38f5a64af6d3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:03.795928 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-3a0ecc92-e2e5-4b74-9894-cb0e46837d38 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:03.818851 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3a0ecc92-e2e5-4b74-9894-cb0e46837d38 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1261 microversion: 2.1 time: 0.207237 Sep 04 16:17:03.820537 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 262/515] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:03 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1261 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:03.944728 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3230e613-8e0c-4dbc-82af-38f5a64af6d3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:03.954278 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3230e613-8e0c-4dbc-82af-38f5a64af6d3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:03.956382 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3230e613-8e0c-4dbc-82af-38f5a64af6d3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:03.957904 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3230e613-8e0c-4dbc-82af-38f5a64af6d3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.197640 Sep 04 16:17:03.961744 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 254/516] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:17:03 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:17:04.344899 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-116ffd95-700f-4d44-ba6f-d52d77182e0d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:04.345510 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-116ffd95-700f-4d44-ba6f-d52d77182e0d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:04.352525 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-116ffd95-700f-4d44-ba6f-d52d77182e0d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:04.353012 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-116ffd95-700f-4d44-ba6f-d52d77182e0d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:04.353444 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-116ffd95-700f-4d44-ba6f-d52d77182e0d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:04.354177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-116ffd95-700f-4d44-ba6f-d52d77182e0d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:04.354632 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-116ffd95-700f-4d44-ba6f-d52d77182e0d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:04.355059 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-116ffd95-700f-4d44-ba6f-d52d77182e0d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:04.375731 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:17:04.508436 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-116ffd95-700f-4d44-ba6f-d52d77182e0d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:04.519682 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-116ffd95-700f-4d44-ba6f-d52d77182e0d tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 200 len: 1318 microversion: 2.1 time: 0.180959 Sep 04 16:17:04.520596 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 263/517] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:04 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:04.576224 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b547b6ad-48d4-4e05-b685-e2cb2e886f84 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:04.581217 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b547b6ad-48d4-4e05-b685-e2cb2e886f84 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:04.584735 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b547b6ad-48d4-4e05-b685-e2cb2e886f84 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:04.585231 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b547b6ad-48d4-4e05-b685-e2cb2e886f84 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:04.586178 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b547b6ad-48d4-4e05-b685-e2cb2e886f84 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:04.586943 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b547b6ad-48d4-4e05-b685-e2cb2e886f84 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:04.587582 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b547b6ad-48d4-4e05-b685-e2cb2e886f84 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:04.588276 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b547b6ad-48d4-4e05-b685-e2cb2e886f84 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:04.807172 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b547b6ad-48d4-4e05-b685-e2cb2e886f84 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:04.818359 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b547b6ad-48d4-4e05-b685-e2cb2e886f84 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1267 microversion: 2.1 time: 0.246567 Sep 04 16:17:04.819306 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 255/518] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:04 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1267 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:17:04.857599 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b1277fb3-a0a8-4a21-b10e-fac42310c363 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:04.858628 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b1277fb3-a0a8-4a21-b10e-fac42310c363 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:04.865450 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1277fb3-a0a8-4a21-b10e-fac42310c363 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:04.866037 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1277fb3-a0a8-4a21-b10e-fac42310c363 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:04.866507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1277fb3-a0a8-4a21-b10e-fac42310c363 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:04.867256 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1277fb3-a0a8-4a21-b10e-fac42310c363 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:04.867846 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1277fb3-a0a8-4a21-b10e-fac42310c363 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:04.868193 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1277fb3-a0a8-4a21-b10e-fac42310c363 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:04.989482 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9bb8da9b-27d2-4b71-a0a0-207bafc7bb63 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:04.990911 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9bb8da9b-27d2-4b71-a0a0-207bafc7bb63 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:04.998465 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9bb8da9b-27d2-4b71-a0a0-207bafc7bb63 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:05.000153 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9bb8da9b-27d2-4b71-a0a0-207bafc7bb63 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:05.000842 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9bb8da9b-27d2-4b71-a0a0-207bafc7bb63 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:05.001821 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9bb8da9b-27d2-4b71-a0a0-207bafc7bb63 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:05.003057 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9bb8da9b-27d2-4b71-a0a0-207bafc7bb63 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:05.003705 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9bb8da9b-27d2-4b71-a0a0-207bafc7bb63 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:05.047113 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b1277fb3-a0a8-4a21-b10e-fac42310c363 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:05.059390 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b1277fb3-a0a8-4a21-b10e-fac42310c363 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1261 microversion: 2.1 time: 0.211692 Sep 04 16:17:05.062035 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 264/519] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:04 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1261 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:17:05.177331 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9bb8da9b-27d2-4b71-a0a0-207bafc7bb63 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:05.177331 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9bb8da9b-27d2-4b71-a0a0-207bafc7bb63 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:05.177665 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9bb8da9b-27d2-4b71-a0a0-207bafc7bb63 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:05.177665 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9bb8da9b-27d2-4b71-a0a0-207bafc7bb63 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.180400 Sep 04 16:17:05.177665 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 256/520] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:17:04 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:17:05.542633 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-24d8f5a4-d03b-42dd-a22c-1747788a455a tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:05.543148 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-24d8f5a4-d03b-42dd-a22c-1747788a455a tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:05.549841 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24d8f5a4-d03b-42dd-a22c-1747788a455a tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:05.550340 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24d8f5a4-d03b-42dd-a22c-1747788a455a tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:05.550769 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24d8f5a4-d03b-42dd-a22c-1747788a455a tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:05.551467 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24d8f5a4-d03b-42dd-a22c-1747788a455a tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:05.551914 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24d8f5a4-d03b-42dd-a22c-1747788a455a tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:05.552331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24d8f5a4-d03b-42dd-a22c-1747788a455a tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:05.716551 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-24d8f5a4-d03b-42dd-a22c-1747788a455a tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:05.725695 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-24d8f5a4-d03b-42dd-a22c-1747788a455a tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 200 len: 1318 microversion: 2.1 time: 0.186885 Sep 04 16:17:05.726877 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 265/521] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:05 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:05.845154 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4ebf3422-64d8-4fe0-876b-97410de556d6 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:05.847318 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4ebf3422-64d8-4fe0-876b-97410de556d6 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:05.858397 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4ebf3422-64d8-4fe0-876b-97410de556d6 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:05.861192 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4ebf3422-64d8-4fe0-876b-97410de556d6 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:05.862372 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4ebf3422-64d8-4fe0-876b-97410de556d6 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:05.863398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4ebf3422-64d8-4fe0-876b-97410de556d6 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:05.863931 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4ebf3422-64d8-4fe0-876b-97410de556d6 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:05.864441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4ebf3422-64d8-4fe0-876b-97410de556d6 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:06.027970 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4ebf3422-64d8-4fe0-876b-97410de556d6 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:06.036402 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4ebf3422-64d8-4fe0-876b-97410de556d6 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1267 microversion: 2.1 time: 0.194882 Sep 04 16:17:06.036981 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 257/522] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:05 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:06.082083 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-66b9b728-015a-454f-869f-434e23398fc5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:06.083641 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-66b9b728-015a-454f-869f-434e23398fc5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:06.091085 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66b9b728-015a-454f-869f-434e23398fc5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:06.091604 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66b9b728-015a-454f-869f-434e23398fc5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:06.092275 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66b9b728-015a-454f-869f-434e23398fc5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:06.093020 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66b9b728-015a-454f-869f-434e23398fc5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:06.093751 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66b9b728-015a-454f-869f-434e23398fc5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:06.094331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-66b9b728-015a-454f-869f-434e23398fc5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:06.214296 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-40edf2a7-a159-4148-a488-aea94120ee52 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:06.215261 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-40edf2a7-a159-4148-a488-aea94120ee52 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:06.236081 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-40edf2a7-a159-4148-a488-aea94120ee52 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:06.236762 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-40edf2a7-a159-4148-a488-aea94120ee52 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:06.238141 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-40edf2a7-a159-4148-a488-aea94120ee52 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:06.241817 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-40edf2a7-a159-4148-a488-aea94120ee52 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:06.242762 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-40edf2a7-a159-4148-a488-aea94120ee52 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:06.243306 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-40edf2a7-a159-4148-a488-aea94120ee52 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:06.284576 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-66b9b728-015a-454f-869f-434e23398fc5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:06.293205 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-66b9b728-015a-454f-869f-434e23398fc5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1261 microversion: 2.1 time: 0.216259 Sep 04 16:17:06.305614 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 266/523] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:06 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1261 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:06.434043 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-40edf2a7-a159-4148-a488-aea94120ee52 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:06.446052 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-40edf2a7-a159-4148-a488-aea94120ee52 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:06.447579 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-40edf2a7-a159-4148-a488-aea94120ee52 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:06.448845 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-40edf2a7-a159-4148-a488-aea94120ee52 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.241321 Sep 04 16:17:06.449404 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 258/524] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:17:06 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:17:06.748375 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-39b57659-8845-4640-9fbb-b3b5c9163851 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:06.749178 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-39b57659-8845-4640-9fbb-b3b5c9163851 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:06.756322 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39b57659-8845-4640-9fbb-b3b5c9163851 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:06.756879 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39b57659-8845-4640-9fbb-b3b5c9163851 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:06.757414 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39b57659-8845-4640-9fbb-b3b5c9163851 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:06.773613 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39b57659-8845-4640-9fbb-b3b5c9163851 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:06.774106 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39b57659-8845-4640-9fbb-b3b5c9163851 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:06.774541 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-39b57659-8845-4640-9fbb-b3b5c9163851 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:06.817783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-89040852-3f71-4ff6-95aa-131510cdf466 req-1a2e7501-c45b-464a-80e3-6bc81d416062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef119005-1210-4108-b0bd-98771fe1fa37", "name": "network-vif-plugged", "status": "completed", "tag": "4f0626e3-395a-4b67-9d54-2a5ea157dccc"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:17:06.834238 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-89040852-3f71-4ff6-95aa-131510cdf466 req-1a2e7501-c45b-464a-80e3-6bc81d416062 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:06.839196 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-89040852-3f71-4ff6-95aa-131510cdf466 req-1a2e7501-c45b-464a-80e3-6bc81d416062 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:06.839196 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-89040852-3f71-4ff6-95aa-131510cdf466 req-1a2e7501-c45b-464a-80e3-6bc81d416062 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:06.852092 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-89040852-3f71-4ff6-95aa-131510cdf466 req-1a2e7501-c45b-464a-80e3-6bc81d416062 service nova] Creating event network-vif-plugged:4f0626e3-395a-4b67-9d54-2a5ea157dccc for instance ef119005-1210-4108-b0bd-98771fe1fa37 on hv-cinder-85236 Sep 04 16:17:06.857154 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-89040852-3f71-4ff6-95aa-131510cdf466 req-1a2e7501-c45b-464a-80e3-6bc81d416062 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052150 Sep 04 16:17:06.858100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 259/525] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:17:06.958423 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-39b57659-8845-4640-9fbb-b3b5c9163851 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:06.975092 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-39b57659-8845-4640-9fbb-b3b5c9163851 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 200 len: 1318 microversion: 2.1 time: 0.224503 Sep 04 16:17:06.976129 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 267/526] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:06 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:07.060591 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-71b200e4-01b2-49bd-9315-0e067b84e64f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:07.061668 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-71b200e4-01b2-49bd-9315-0e067b84e64f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:07.069009 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71b200e4-01b2-49bd-9315-0e067b84e64f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:07.069505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71b200e4-01b2-49bd-9315-0e067b84e64f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:07.069967 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71b200e4-01b2-49bd-9315-0e067b84e64f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:07.070676 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71b200e4-01b2-49bd-9315-0e067b84e64f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:07.071221 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71b200e4-01b2-49bd-9315-0e067b84e64f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:07.071662 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71b200e4-01b2-49bd-9315-0e067b84e64f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:07.210583 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-71b200e4-01b2-49bd-9315-0e067b84e64f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:07.222005 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-71b200e4-01b2-49bd-9315-0e067b84e64f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1267 microversion: 2.1 time: 0.165463 Sep 04 16:17:07.222649 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 260/527] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:07 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:07.316046 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4d0a0e09-054f-4c3d-8e8b-733cf76e0129 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:07.316652 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4d0a0e09-054f-4c3d-8e8b-733cf76e0129 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:07.322688 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d0a0e09-054f-4c3d-8e8b-733cf76e0129 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:07.323168 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d0a0e09-054f-4c3d-8e8b-733cf76e0129 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:07.323596 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d0a0e09-054f-4c3d-8e8b-733cf76e0129 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:07.324314 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d0a0e09-054f-4c3d-8e8b-733cf76e0129 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:07.324742 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d0a0e09-054f-4c3d-8e8b-733cf76e0129 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:07.325150 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d0a0e09-054f-4c3d-8e8b-733cf76e0129 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:07.457399 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4d0a0e09-054f-4c3d-8e8b-733cf76e0129 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:07.465093 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4d0a0e09-054f-4c3d-8e8b-733cf76e0129 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1261 microversion: 2.1 time: 0.152893 Sep 04 16:17:07.465667 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 268/528] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:07 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:07.475227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-eb9fb97a-fb95-4255-a631-d98ab90975ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:07.475978 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-eb9fb97a-fb95-4255-a631-d98ab90975ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:07.482400 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eb9fb97a-fb95-4255-a631-d98ab90975ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:07.482928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eb9fb97a-fb95-4255-a631-d98ab90975ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:07.483364 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eb9fb97a-fb95-4255-a631-d98ab90975ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:07.484087 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eb9fb97a-fb95-4255-a631-d98ab90975ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:07.484541 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eb9fb97a-fb95-4255-a631-d98ab90975ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:07.484962 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eb9fb97a-fb95-4255-a631-d98ab90975ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:07.622329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-eb9fb97a-fb95-4255-a631-d98ab90975ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:07.632189 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-eb9fb97a-fb95-4255-a631-d98ab90975ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:07.633673 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-eb9fb97a-fb95-4255-a631-d98ab90975ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:07.634847 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-eb9fb97a-fb95-4255-a631-d98ab90975ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.164198 Sep 04 16:17:07.653927 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 261/529] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:17:07 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:17:07.999523 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-717efe87-cf43-4365-aa5e-14b9ad0736b5 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:08.000492 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-717efe87-cf43-4365-aa5e-14b9ad0736b5 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:08.010236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-717efe87-cf43-4365-aa5e-14b9ad0736b5 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:08.011051 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-717efe87-cf43-4365-aa5e-14b9ad0736b5 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:08.011861 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-717efe87-cf43-4365-aa5e-14b9ad0736b5 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:08.012812 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-717efe87-cf43-4365-aa5e-14b9ad0736b5 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:08.013530 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-717efe87-cf43-4365-aa5e-14b9ad0736b5 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:08.014542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-717efe87-cf43-4365-aa5e-14b9ad0736b5 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:08.173405 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-717efe87-cf43-4365-aa5e-14b9ad0736b5 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:08.181207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-717efe87-cf43-4365-aa5e-14b9ad0736b5 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 200 len: 1318 microversion: 2.1 time: 0.185506 Sep 04 16:17:08.181820 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 269/530] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:07 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:08.245528 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-82041dff-a292-40dc-9cd6-29b12e580b65 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:08.246166 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-82041dff-a292-40dc-9cd6-29b12e580b65 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:08.253692 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-82041dff-a292-40dc-9cd6-29b12e580b65 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:08.254180 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-82041dff-a292-40dc-9cd6-29b12e580b65 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:08.254618 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-82041dff-a292-40dc-9cd6-29b12e580b65 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:08.255311 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-82041dff-a292-40dc-9cd6-29b12e580b65 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:08.255769 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-82041dff-a292-40dc-9cd6-29b12e580b65 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:08.256196 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-82041dff-a292-40dc-9cd6-29b12e580b65 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:08.416776 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-82041dff-a292-40dc-9cd6-29b12e580b65 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:08.427434 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-82041dff-a292-40dc-9cd6-29b12e580b65 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1267 microversion: 2.1 time: 0.185102 Sep 04 16:17:08.437321 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 262/531] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:08 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:08.490048 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d38121a1-775b-46c0-834b-8c866ddd6763 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:08.503756 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d38121a1-775b-46c0-834b-8c866ddd6763 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:08.503756 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d38121a1-775b-46c0-834b-8c866ddd6763 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:08.503756 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d38121a1-775b-46c0-834b-8c866ddd6763 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:08.503756 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d38121a1-775b-46c0-834b-8c866ddd6763 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:08.504149 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d38121a1-775b-46c0-834b-8c866ddd6763 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:08.504149 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d38121a1-775b-46c0-834b-8c866ddd6763 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:08.504149 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d38121a1-775b-46c0-834b-8c866ddd6763 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:08.662132 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d38121a1-775b-46c0-834b-8c866ddd6763 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:08.672212 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d38121a1-775b-46c0-834b-8c866ddd6763 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1261 microversion: 2.1 time: 0.186957 Sep 04 16:17:08.684680 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-19bdfd78-7d3a-49b3-aaf4-923341e6b9e7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:08.684680 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-19bdfd78-7d3a-49b3-aaf4-923341e6b9e7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:08.688131 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-19bdfd78-7d3a-49b3-aaf4-923341e6b9e7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:08.688131 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-19bdfd78-7d3a-49b3-aaf4-923341e6b9e7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:08.688131 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-19bdfd78-7d3a-49b3-aaf4-923341e6b9e7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:08.688674 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-19bdfd78-7d3a-49b3-aaf4-923341e6b9e7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:08.689620 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-19bdfd78-7d3a-49b3-aaf4-923341e6b9e7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:08.689620 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-19bdfd78-7d3a-49b3-aaf4-923341e6b9e7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:08.689928 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 270/532] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:08 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1261 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:08.694749 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:17:08.877856 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-19bdfd78-7d3a-49b3-aaf4-923341e6b9e7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:08.897720 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-19bdfd78-7d3a-49b3-aaf4-923341e6b9e7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:08.898084 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-19bdfd78-7d3a-49b3-aaf4-923341e6b9e7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:08.900548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-19bdfd78-7d3a-49b3-aaf4-923341e6b9e7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.223944 Sep 04 16:17:08.902994 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 263/533] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:17:08 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:17:09.204185 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-028ccda0-fcf1-411a-a52b-ea5ff792bfea tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:09.204737 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-028ccda0-fcf1-411a-a52b-ea5ff792bfea tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:09.212655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-028ccda0-fcf1-411a-a52b-ea5ff792bfea tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:09.213125 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-028ccda0-fcf1-411a-a52b-ea5ff792bfea tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:09.213552 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-028ccda0-fcf1-411a-a52b-ea5ff792bfea tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:09.214304 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-028ccda0-fcf1-411a-a52b-ea5ff792bfea tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:09.215426 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-028ccda0-fcf1-411a-a52b-ea5ff792bfea tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:09.215870 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-028ccda0-fcf1-411a-a52b-ea5ff792bfea tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:09.352282 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-028ccda0-fcf1-411a-a52b-ea5ff792bfea tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:09.363125 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-028ccda0-fcf1-411a-a52b-ea5ff792bfea tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 200 len: 1318 microversion: 2.1 time: 0.162954 Sep 04 16:17:09.364078 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 271/534] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:09 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:09.456499 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-29a8a522-2891-4056-8989-60bae048f395 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:09.457086 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-29a8a522-2891-4056-8989-60bae048f395 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:09.463992 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29a8a522-2891-4056-8989-60bae048f395 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:09.464474 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29a8a522-2891-4056-8989-60bae048f395 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:09.464958 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29a8a522-2891-4056-8989-60bae048f395 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:09.465683 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29a8a522-2891-4056-8989-60bae048f395 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:09.466140 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29a8a522-2891-4056-8989-60bae048f395 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:09.466566 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29a8a522-2891-4056-8989-60bae048f395 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:09.601534 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-29a8a522-2891-4056-8989-60bae048f395 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:09.609287 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-29a8a522-2891-4056-8989-60bae048f395 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1267 microversion: 2.1 time: 0.157412 Sep 04 16:17:09.609910 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 264/535] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:09 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:09.706801 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e9f4f734-da6c-47ba-9ba0-959be8f71003 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:09.707357 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e9f4f734-da6c-47ba-9ba0-959be8f71003 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:09.713468 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9f4f734-da6c-47ba-9ba0-959be8f71003 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:09.713974 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9f4f734-da6c-47ba-9ba0-959be8f71003 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:09.714407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9f4f734-da6c-47ba-9ba0-959be8f71003 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:09.715087 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9f4f734-da6c-47ba-9ba0-959be8f71003 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:09.715534 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9f4f734-da6c-47ba-9ba0-959be8f71003 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:09.716006 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9f4f734-da6c-47ba-9ba0-959be8f71003 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:09.845821 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e9f4f734-da6c-47ba-9ba0-959be8f71003 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:09.854135 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e9f4f734-da6c-47ba-9ba0-959be8f71003 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1261 microversion: 2.1 time: 0.152522 Sep 04 16:17:09.854692 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 272/536] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:09 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:09.929335 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0c1eac02-d38a-4a08-be8f-86cab509ff55 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:09.929961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0c1eac02-d38a-4a08-be8f-86cab509ff55 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:09.935967 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c1eac02-d38a-4a08-be8f-86cab509ff55 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:09.936444 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c1eac02-d38a-4a08-be8f-86cab509ff55 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:09.936872 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c1eac02-d38a-4a08-be8f-86cab509ff55 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:09.937555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c1eac02-d38a-4a08-be8f-86cab509ff55 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:09.938034 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c1eac02-d38a-4a08-be8f-86cab509ff55 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:09.938451 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c1eac02-d38a-4a08-be8f-86cab509ff55 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:10.068208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0c1eac02-d38a-4a08-be8f-86cab509ff55 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:10.077049 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0c1eac02-d38a-4a08-be8f-86cab509ff55 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:10.078525 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0c1eac02-d38a-4a08-be8f-86cab509ff55 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:10.079686 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0c1eac02-d38a-4a08-be8f-86cab509ff55 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.154348 Sep 04 16:17:10.080791 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 265/537] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:17:09 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:17:10.386226 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2ea25774-79d5-46dc-af63-1c7393333c3c tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:10.386901 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2ea25774-79d5-46dc-af63-1c7393333c3c tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:10.394242 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ea25774-79d5-46dc-af63-1c7393333c3c tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:10.397306 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ea25774-79d5-46dc-af63-1c7393333c3c tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:10.397306 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ea25774-79d5-46dc-af63-1c7393333c3c tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:10.397306 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ea25774-79d5-46dc-af63-1c7393333c3c tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:10.397306 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ea25774-79d5-46dc-af63-1c7393333c3c tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:10.398079 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ea25774-79d5-46dc-af63-1c7393333c3c tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:10.528624 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2ea25774-79d5-46dc-af63-1c7393333c3c tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:10.540539 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2ea25774-79d5-46dc-af63-1c7393333c3c tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 200 len: 1318 microversion: 2.1 time: 0.158038 Sep 04 16:17:10.541136 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 273/538] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:10 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:10.632819 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-00b1ff18-9913-437c-b004-cdc110da0f0b tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:10.633428 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-00b1ff18-9913-437c-b004-cdc110da0f0b tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:10.640689 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-00b1ff18-9913-437c-b004-cdc110da0f0b tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:10.641173 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-00b1ff18-9913-437c-b004-cdc110da0f0b tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:10.641625 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-00b1ff18-9913-437c-b004-cdc110da0f0b tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:10.642405 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-00b1ff18-9913-437c-b004-cdc110da0f0b tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:10.643425 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-00b1ff18-9913-437c-b004-cdc110da0f0b tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:10.644553 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-00b1ff18-9913-437c-b004-cdc110da0f0b tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:10.780424 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-00b1ff18-9913-437c-b004-cdc110da0f0b tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:10.788403 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-00b1ff18-9913-437c-b004-cdc110da0f0b tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1267 microversion: 2.1 time: 0.159615 Sep 04 16:17:10.788973 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 266/539] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:10 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:17:10.877308 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6c5ead54-4713-43b0-a912-1835e40c101d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:10.878045 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6c5ead54-4713-43b0-a912-1835e40c101d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:10.884244 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c5ead54-4713-43b0-a912-1835e40c101d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:10.884672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c5ead54-4713-43b0-a912-1835e40c101d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:10.885106 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c5ead54-4713-43b0-a912-1835e40c101d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:10.885832 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c5ead54-4713-43b0-a912-1835e40c101d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:10.886288 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c5ead54-4713-43b0-a912-1835e40c101d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:10.886709 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c5ead54-4713-43b0-a912-1835e40c101d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:11.019153 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-6c5ead54-4713-43b0-a912-1835e40c101d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:11.026987 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6c5ead54-4713-43b0-a912-1835e40c101d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1261 microversion: 2.1 time: 0.153634 Sep 04 16:17:11.027547 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 274/540] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:10 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:11.106257 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a27b52b6-5c4c-4e7a-8e43-4446f644a66f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:11.107561 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a27b52b6-5c4c-4e7a-8e43-4446f644a66f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:11.113539 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a27b52b6-5c4c-4e7a-8e43-4446f644a66f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:11.114041 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a27b52b6-5c4c-4e7a-8e43-4446f644a66f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:11.114468 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a27b52b6-5c4c-4e7a-8e43-4446f644a66f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:11.115147 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a27b52b6-5c4c-4e7a-8e43-4446f644a66f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:11.115591 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a27b52b6-5c4c-4e7a-8e43-4446f644a66f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:11.116001 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a27b52b6-5c4c-4e7a-8e43-4446f644a66f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:11.327410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a27b52b6-5c4c-4e7a-8e43-4446f644a66f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:11.337077 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a27b52b6-5c4c-4e7a-8e43-4446f644a66f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:11.338610 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a27b52b6-5c4c-4e7a-8e43-4446f644a66f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:11.339849 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a27b52b6-5c4c-4e7a-8e43-4446f644a66f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.237572 Sep 04 16:17:11.340449 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 267/541] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:17:11 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:17:11.563871 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5c1c75f2-a7a1-47e5-9f25-c2af719f02cf tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:11.564399 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5c1c75f2-a7a1-47e5-9f25-c2af719f02cf tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:11.571528 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c1c75f2-a7a1-47e5-9f25-c2af719f02cf tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:11.572002 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c1c75f2-a7a1-47e5-9f25-c2af719f02cf tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:11.572427 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c1c75f2-a7a1-47e5-9f25-c2af719f02cf tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:11.573112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c1c75f2-a7a1-47e5-9f25-c2af719f02cf tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:11.573578 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c1c75f2-a7a1-47e5-9f25-c2af719f02cf tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:11.573994 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5c1c75f2-a7a1-47e5-9f25-c2af719f02cf tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:11.707639 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5c1c75f2-a7a1-47e5-9f25-c2af719f02cf tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:11.715288 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5c1c75f2-a7a1-47e5-9f25-c2af719f02cf tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 200 len: 1318 microversion: 2.1 time: 0.155358 Sep 04 16:17:11.715884 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 275/542] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:11 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:11.814701 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3e64361e-ea74-4ed6-aa0a-8345af49646e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:11.817346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3e64361e-ea74-4ed6-aa0a-8345af49646e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:11.824608 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e64361e-ea74-4ed6-aa0a-8345af49646e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:11.824608 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e64361e-ea74-4ed6-aa0a-8345af49646e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:11.824608 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e64361e-ea74-4ed6-aa0a-8345af49646e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:11.824608 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e64361e-ea74-4ed6-aa0a-8345af49646e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:11.825042 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e64361e-ea74-4ed6-aa0a-8345af49646e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:11.825640 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e64361e-ea74-4ed6-aa0a-8345af49646e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:12.051347 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f2e7958c-9c5e-40ee-9ba8-7a7add82868d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:12.052050 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f2e7958c-9c5e-40ee-9ba8-7a7add82868d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:12.058492 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2e7958c-9c5e-40ee-9ba8-7a7add82868d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:12.058976 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2e7958c-9c5e-40ee-9ba8-7a7add82868d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:12.059456 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2e7958c-9c5e-40ee-9ba8-7a7add82868d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:12.060201 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2e7958c-9c5e-40ee-9ba8-7a7add82868d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:12.060646 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2e7958c-9c5e-40ee-9ba8-7a7add82868d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:12.061199 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f2e7958c-9c5e-40ee-9ba8-7a7add82868d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:12.381382 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f2e7958c-9c5e-40ee-9ba8-7a7add82868d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:12.384700 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3e64361e-ea74-4ed6-aa0a-8345af49646e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:12.389717 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f2e7958c-9c5e-40ee-9ba8-7a7add82868d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1446 microversion: 2.1 time: 0.342937 Sep 04 16:17:12.390288 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 276/543] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:12 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1446 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:17:12.393078 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3e64361e-ea74-4ed6-aa0a-8345af49646e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1267 microversion: 2.1 time: 0.584057 Sep 04 16:17:12.393910 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 268/544] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:11 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1267 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:12.394844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-54fa21f1-5d19-4ed0-8561-23a6fdb4366b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:12.395442 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-54fa21f1-5d19-4ed0-8561-23a6fdb4366b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:12.401104 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54fa21f1-5d19-4ed0-8561-23a6fdb4366b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:12.401590 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54fa21f1-5d19-4ed0-8561-23a6fdb4366b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:12.402042 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54fa21f1-5d19-4ed0-8561-23a6fdb4366b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:12.402716 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54fa21f1-5d19-4ed0-8561-23a6fdb4366b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:12.403163 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54fa21f1-5d19-4ed0-8561-23a6fdb4366b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:12.403575 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54fa21f1-5d19-4ed0-8561-23a6fdb4366b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:12.413496 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cb943a90-053c-4ee1-9ff4-3a30247ba8b6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:12.414130 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cb943a90-053c-4ee1-9ff4-3a30247ba8b6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:12.419975 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cb943a90-053c-4ee1-9ff4-3a30247ba8b6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:12.420451 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cb943a90-053c-4ee1-9ff4-3a30247ba8b6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:12.420879 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cb943a90-053c-4ee1-9ff4-3a30247ba8b6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:12.421576 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cb943a90-053c-4ee1-9ff4-3a30247ba8b6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:12.422029 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cb943a90-053c-4ee1-9ff4-3a30247ba8b6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:12.422446 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cb943a90-053c-4ee1-9ff4-3a30247ba8b6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:12.598877 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-54fa21f1-5d19-4ed0-8561-23a6fdb4366b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:12.607586 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-54fa21f1-5d19-4ed0-8561-23a6fdb4366b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:12.609136 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-54fa21f1-5d19-4ed0-8561-23a6fdb4366b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:12.610445 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-54fa21f1-5d19-4ed0-8561-23a6fdb4366b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.219246 Sep 04 16:17:12.613622 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 277/545] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:17:12 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:17:12.613763 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-cb943a90-053c-4ee1-9ff4-3a30247ba8b6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:12.621498 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cb943a90-053c-4ee1-9ff4-3a30247ba8b6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1446 microversion: 2.1 time: 0.211733 Sep 04 16:17:12.622085 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 269/546] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:12 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1446 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:12.740809 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c683f3ab-4e63-4847-868a-c661e5c0e791 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:12.741908 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c683f3ab-4e63-4847-868a-c661e5c0e791 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:12.747965 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c683f3ab-4e63-4847-868a-c661e5c0e791 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:12.748480 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c683f3ab-4e63-4847-868a-c661e5c0e791 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:12.749425 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c683f3ab-4e63-4847-868a-c661e5c0e791 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:12.749600 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c683f3ab-4e63-4847-868a-c661e5c0e791 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:12.750054 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c683f3ab-4e63-4847-868a-c661e5c0e791 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:12.750471 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c683f3ab-4e63-4847-868a-c661e5c0e791 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:12.912512 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c683f3ab-4e63-4847-868a-c661e5c0e791 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:12.920440 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c683f3ab-4e63-4847-868a-c661e5c0e791 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 200 len: 1318 microversion: 2.1 time: 0.184474 Sep 04 16:17:12.920997 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 278/547] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:12 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:13.415905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-63590ee3-77f9-4aeb-8d1e-ddc656246ceb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:13.416529 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-63590ee3-77f9-4aeb-8d1e-ddc656246ceb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:13.425856 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-63590ee3-77f9-4aeb-8d1e-ddc656246ceb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:13.425856 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-63590ee3-77f9-4aeb-8d1e-ddc656246ceb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:13.425856 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-63590ee3-77f9-4aeb-8d1e-ddc656246ceb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:13.425856 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-63590ee3-77f9-4aeb-8d1e-ddc656246ceb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:13.426236 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-63590ee3-77f9-4aeb-8d1e-ddc656246ceb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:13.426236 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-63590ee3-77f9-4aeb-8d1e-ddc656246ceb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:13.599726 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-63590ee3-77f9-4aeb-8d1e-ddc656246ceb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:13.614940 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-63590ee3-77f9-4aeb-8d1e-ddc656246ceb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1267 microversion: 2.1 time: 0.202759 Sep 04 16:17:13.626103 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 270/548] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:13 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:13.636965 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8c744018-c13d-4df2-a080-5ba1d59f808b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:13.643517 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8c744018-c13d-4df2-a080-5ba1d59f808b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:13.645202 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c744018-c13d-4df2-a080-5ba1d59f808b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:13.645929 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c744018-c13d-4df2-a080-5ba1d59f808b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:13.646434 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c744018-c13d-4df2-a080-5ba1d59f808b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:13.647297 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c744018-c13d-4df2-a080-5ba1d59f808b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:13.647837 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c744018-c13d-4df2-a080-5ba1d59f808b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:13.648326 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8c744018-c13d-4df2-a080-5ba1d59f808b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:13.844445 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-8c744018-c13d-4df2-a080-5ba1d59f808b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:13.855074 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-8c744018-c13d-4df2-a080-5ba1d59f808b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:13.856586 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-8c744018-c13d-4df2-a080-5ba1d59f808b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:13.857782 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8c744018-c13d-4df2-a080-5ba1d59f808b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.225235 Sep 04 16:17:13.858380 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 279/549] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:17:13 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:17:13.943423 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c4fcf1e1-e8d9-4180-b78f-7f51b544a058 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:13.944038 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c4fcf1e1-e8d9-4180-b78f-7f51b544a058 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:13.950040 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c4fcf1e1-e8d9-4180-b78f-7f51b544a058 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:13.950521 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c4fcf1e1-e8d9-4180-b78f-7f51b544a058 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:13.951155 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c4fcf1e1-e8d9-4180-b78f-7f51b544a058 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:13.951853 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c4fcf1e1-e8d9-4180-b78f-7f51b544a058 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:13.952306 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c4fcf1e1-e8d9-4180-b78f-7f51b544a058 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:13.952735 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c4fcf1e1-e8d9-4180-b78f-7f51b544a058 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:14.084395 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c4fcf1e1-e8d9-4180-b78f-7f51b544a058 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:14.092156 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c4fcf1e1-e8d9-4180-b78f-7f51b544a058 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 200 len: 1507 microversion: 2.1 time: 0.152747 Sep 04 16:17:14.096616 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 271/550] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:13 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:17:14.115995 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3a84610f-64d0-445f-805e-6df1573ce4b4 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a02c19d-3664-4fd3-9910-19553e509e41", "device": "/dev/sdb"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:17:14.119019 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3a84610f-64d0-445f-805e-6df1573ce4b4 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:14.125302 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a84610f-64d0-445f-805e-6df1573ce4b4 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:14.125817 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a84610f-64d0-445f-805e-6df1573ce4b4 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:14.126250 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a84610f-64d0-445f-805e-6df1573ce4b4 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:14.126932 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a84610f-64d0-445f-805e-6df1573ce4b4 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:14.127442 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a84610f-64d0-445f-805e-6df1573ce4b4 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:14.127873 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3a84610f-64d0-445f-805e-6df1573ce4b4 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:14.131487 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:17:14.640891 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9cbc4de0-f1f7-4c54-a9d3-39d4296b74b8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:14.642748 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9cbc4de0-f1f7-4c54-a9d3-39d4296b74b8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:14.651493 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9cbc4de0-f1f7-4c54-a9d3-39d4296b74b8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:14.652603 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9cbc4de0-f1f7-4c54-a9d3-39d4296b74b8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:14.653340 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9cbc4de0-f1f7-4c54-a9d3-39d4296b74b8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:14.654263 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9cbc4de0-f1f7-4c54-a9d3-39d4296b74b8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:14.654874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9cbc4de0-f1f7-4c54-a9d3-39d4296b74b8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:14.655306 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9cbc4de0-f1f7-4c54-a9d3-39d4296b74b8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:14.803942 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9cbc4de0-f1f7-4c54-a9d3-39d4296b74b8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:14.811909 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9cbc4de0-f1f7-4c54-a9d3-39d4296b74b8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1267 microversion: 2.1 time: 0.175346 Sep 04 16:17:14.812473 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 272/551] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:14 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:17:14.882829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-97f213dc-d037-4299-9540-cb152da1c316 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:14.895827 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-97f213dc-d037-4299-9540-cb152da1c316 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:14.895827 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-97f213dc-d037-4299-9540-cb152da1c316 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:14.895827 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-97f213dc-d037-4299-9540-cb152da1c316 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:14.895827 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-97f213dc-d037-4299-9540-cb152da1c316 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:14.896267 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-97f213dc-d037-4299-9540-cb152da1c316 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:14.896267 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-97f213dc-d037-4299-9540-cb152da1c316 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:14.896267 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-97f213dc-d037-4299-9540-cb152da1c316 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:15.025435 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-97f213dc-d037-4299-9540-cb152da1c316 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:15.036622 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-97f213dc-d037-4299-9540-cb152da1c316 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:15.038106 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-97f213dc-d037-4299-9540-cb152da1c316 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:15.043856 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-97f213dc-d037-4299-9540-cb152da1c316 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.160447 Sep 04 16:17:15.043856 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 273/552] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:17:14 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:17:15.044344 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-ed57fe76-a9ca-48ad-a45c-2e9a8a8a8e3c req-89ab5b9a-848d-4527-98ca-65bd26462795 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84acd9f2-8732-4d8b-843e-46e2ccd5e5cc", "tag": "b7aa303d-deea-4135-89b8-303faf88bdfe"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:17:15.049337 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:17:15.054669 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-ed57fe76-a9ca-48ad-a45c-2e9a8a8a8e3c req-89ab5b9a-848d-4527-98ca-65bd26462795 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:15.055141 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-ed57fe76-a9ca-48ad-a45c-2e9a8a8a8e3c req-89ab5b9a-848d-4527-98ca-65bd26462795 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:15.055559 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-ed57fe76-a9ca-48ad-a45c-2e9a8a8a8e3c req-89ab5b9a-848d-4527-98ca-65bd26462795 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:15.077538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-ed57fe76-a9ca-48ad-a45c-2e9a8a8a8e3c req-89ab5b9a-848d-4527-98ca-65bd26462795 service nova] Creating event network-changed:b7aa303d-deea-4135-89b8-303faf88bdfe for instance 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc on hv-cinder-85236 Sep 04 16:17:15.077538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-ed57fe76-a9ca-48ad-a45c-2e9a8a8a8e3c req-89ab5b9a-848d-4527-98ca-65bd26462795 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035176 Sep 04 16:17:15.077538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 274/553] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:17:15.716986 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3a84610f-64d0-445f-805e-6df1573ce4b4 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "POST /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.605495 Sep 04 16:17:15.719039 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 280/554] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Sep 4 16:17:14 2022] POST /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37/os-volume_attachments => generated 194 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:17:15.837018 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2f96b1d7-89cc-46ee-bbef-55ffee485003 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:15.837743 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2f96b1d7-89cc-46ee-bbef-55ffee485003 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:15.843920 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f96b1d7-89cc-46ee-bbef-55ffee485003 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:15.844396 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f96b1d7-89cc-46ee-bbef-55ffee485003 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:15.844833 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f96b1d7-89cc-46ee-bbef-55ffee485003 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:15.845518 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f96b1d7-89cc-46ee-bbef-55ffee485003 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:15.846615 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f96b1d7-89cc-46ee-bbef-55ffee485003 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:15.847379 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f96b1d7-89cc-46ee-bbef-55ffee485003 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:15.981482 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2f96b1d7-89cc-46ee-bbef-55ffee485003 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:15.989364 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2f96b1d7-89cc-46ee-bbef-55ffee485003 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1453 microversion: 2.1 time: 0.157434 Sep 04 16:17:15.989953 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 275/555] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:15 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:16.012786 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f3163886-aef3-4f85-97bb-be66a2c67304 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:16.013475 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f3163886-aef3-4f85-97bb-be66a2c67304 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:16.020360 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3163886-aef3-4f85-97bb-be66a2c67304 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:16.020834 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3163886-aef3-4f85-97bb-be66a2c67304 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:16.021263 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3163886-aef3-4f85-97bb-be66a2c67304 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:16.021964 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3163886-aef3-4f85-97bb-be66a2c67304 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:16.022413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3163886-aef3-4f85-97bb-be66a2c67304 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:16.022827 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3163886-aef3-4f85-97bb-be66a2c67304 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:16.064366 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ad981cad-4432-4c77-9b8d-84ddd0693d20 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:16.065225 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ad981cad-4432-4c77-9b8d-84ddd0693d20 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:16.071902 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad981cad-4432-4c77-9b8d-84ddd0693d20 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:16.072574 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad981cad-4432-4c77-9b8d-84ddd0693d20 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:16.073164 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad981cad-4432-4c77-9b8d-84ddd0693d20 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:16.074934 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad981cad-4432-4c77-9b8d-84ddd0693d20 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:16.075936 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad981cad-4432-4c77-9b8d-84ddd0693d20 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:16.076748 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad981cad-4432-4c77-9b8d-84ddd0693d20 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:16.212949 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f3163886-aef3-4f85-97bb-be66a2c67304 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:16.220775 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f3163886-aef3-4f85-97bb-be66a2c67304 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1453 microversion: 2.1 time: 0.212832 Sep 04 16:17:16.222081 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 281/556] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:16 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1453 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:16.238600 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ad981cad-4432-4c77-9b8d-84ddd0693d20 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:16.247660 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ad981cad-4432-4c77-9b8d-84ddd0693d20 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:16.249191 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ad981cad-4432-4c77-9b8d-84ddd0693d20 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:16.250488 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ad981cad-4432-4c77-9b8d-84ddd0693d20 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.190050 Sep 04 16:17:16.251256 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 276/557] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:17:16 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:17:17.278635 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6c7f4555-6b42-4c1e-9d78-7f9339148900 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:17.279240 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6c7f4555-6b42-4c1e-9d78-7f9339148900 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:17.286463 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c7f4555-6b42-4c1e-9d78-7f9339148900 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:17.286946 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c7f4555-6b42-4c1e-9d78-7f9339148900 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:17.287462 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c7f4555-6b42-4c1e-9d78-7f9339148900 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:17.288078 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c7f4555-6b42-4c1e-9d78-7f9339148900 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:17.288526 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c7f4555-6b42-4c1e-9d78-7f9339148900 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:17.288946 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6c7f4555-6b42-4c1e-9d78-7f9339148900 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:17.544426 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-6c7f4555-6b42-4c1e-9d78-7f9339148900 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:17.554105 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-6c7f4555-6b42-4c1e-9d78-7f9339148900 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:17.555590 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-6c7f4555-6b42-4c1e-9d78-7f9339148900 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:17.556739 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6c7f4555-6b42-4c1e-9d78-7f9339148900 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.282056 Sep 04 16:17:17.557286 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 282/558] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:17:17 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:17:18.583996 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-25874897-efd8-4b79-abea-73ed9d83a015 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:18.584737 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-25874897-efd8-4b79-abea-73ed9d83a015 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:18.591157 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-25874897-efd8-4b79-abea-73ed9d83a015 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:18.591642 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-25874897-efd8-4b79-abea-73ed9d83a015 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:18.592097 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-25874897-efd8-4b79-abea-73ed9d83a015 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:18.592759 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-25874897-efd8-4b79-abea-73ed9d83a015 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:18.593361 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-25874897-efd8-4b79-abea-73ed9d83a015 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:18.597822 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-25874897-efd8-4b79-abea-73ed9d83a015 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:18.698827 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-89727a2d-a448-4ef7-b4ec-6186a07c386d req-1a587c94-4fd6-41b4-9134-fb626cf7e16c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d24964d-b2cb-420a-9232-b5662800ec31", "tag": "16088940-01d4-4b7c-9350-5157b311afa1"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:17:18.714692 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-89727a2d-a448-4ef7-b4ec-6186a07c386d req-1a587c94-4fd6-41b4-9134-fb626cf7e16c service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:18.715177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-89727a2d-a448-4ef7-b4ec-6186a07c386d req-1a587c94-4fd6-41b4-9134-fb626cf7e16c service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:18.715604 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-89727a2d-a448-4ef7-b4ec-6186a07c386d req-1a587c94-4fd6-41b4-9134-fb626cf7e16c service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:18.727039 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-89727a2d-a448-4ef7-b4ec-6186a07c386d req-1a587c94-4fd6-41b4-9134-fb626cf7e16c service nova] Creating event network-changed:16088940-01d4-4b7c-9350-5157b311afa1 for instance 5d24964d-b2cb-420a-9232-b5662800ec31 on hv-cinder-85236 Sep 04 16:17:18.732225 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-89727a2d-a448-4ef7-b4ec-6186a07c386d req-1a587c94-4fd6-41b4-9134-fb626cf7e16c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037254 Sep 04 16:17:18.733155 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 283/559] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:17:18.760096 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-25874897-efd8-4b79-abea-73ed9d83a015 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:18.769480 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-25874897-efd8-4b79-abea-73ed9d83a015 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:18.770947 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-25874897-efd8-4b79-abea-73ed9d83a015 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:18.772083 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-25874897-efd8-4b79-abea-73ed9d83a015 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.193314 Sep 04 16:17:18.772642 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 277/560] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:17:18 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:17:19.799836 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-484d4cb3-66a0-4736-83f4-18d95c087cb1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:19.800501 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-484d4cb3-66a0-4736-83f4-18d95c087cb1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:19.806595 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-484d4cb3-66a0-4736-83f4-18d95c087cb1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:19.807073 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-484d4cb3-66a0-4736-83f4-18d95c087cb1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:19.807506 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-484d4cb3-66a0-4736-83f4-18d95c087cb1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:19.808191 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-484d4cb3-66a0-4736-83f4-18d95c087cb1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:19.808641 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-484d4cb3-66a0-4736-83f4-18d95c087cb1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:19.809060 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-484d4cb3-66a0-4736-83f4-18d95c087cb1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:19.939366 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-484d4cb3-66a0-4736-83f4-18d95c087cb1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:19.948394 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-484d4cb3-66a0-4736-83f4-18d95c087cb1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:19.949867 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-484d4cb3-66a0-4736-83f4-18d95c087cb1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:19.951058 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-484d4cb3-66a0-4736-83f4-18d95c087cb1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.156701 Sep 04 16:17:19.951624 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 284/561] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:17:19 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:17:20.976064 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fa426a8c-23ba-480c-80ed-5c7908ecb54e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:20.976655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fa426a8c-23ba-480c-80ed-5c7908ecb54e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:20.983266 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fa426a8c-23ba-480c-80ed-5c7908ecb54e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:20.983691 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fa426a8c-23ba-480c-80ed-5c7908ecb54e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:20.984122 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fa426a8c-23ba-480c-80ed-5c7908ecb54e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:20.984836 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fa426a8c-23ba-480c-80ed-5c7908ecb54e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:20.985256 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fa426a8c-23ba-480c-80ed-5c7908ecb54e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:20.985700 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fa426a8c-23ba-480c-80ed-5c7908ecb54e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:21.130382 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fa426a8c-23ba-480c-80ed-5c7908ecb54e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:21.139142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fa426a8c-23ba-480c-80ed-5c7908ecb54e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:21.140594 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fa426a8c-23ba-480c-80ed-5c7908ecb54e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:21.141763 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fa426a8c-23ba-480c-80ed-5c7908ecb54e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.169640 Sep 04 16:17:21.142325 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 278/562] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:17:20 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:17:22.167102 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1059548c-b0b0-4a31-a33d-3002dac0e95b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:22.167707 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1059548c-b0b0-4a31-a33d-3002dac0e95b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:22.174445 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1059548c-b0b0-4a31-a33d-3002dac0e95b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:22.178832 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1059548c-b0b0-4a31-a33d-3002dac0e95b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:22.178832 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1059548c-b0b0-4a31-a33d-3002dac0e95b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:22.178832 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1059548c-b0b0-4a31-a33d-3002dac0e95b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:22.178832 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1059548c-b0b0-4a31-a33d-3002dac0e95b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:22.179188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1059548c-b0b0-4a31-a33d-3002dac0e95b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:22.309382 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1059548c-b0b0-4a31-a33d-3002dac0e95b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:22.318359 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1059548c-b0b0-4a31-a33d-3002dac0e95b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:22.319968 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1059548c-b0b0-4a31-a33d-3002dac0e95b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:22.321129 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1059548c-b0b0-4a31-a33d-3002dac0e95b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.157990 Sep 04 16:17:22.321704 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 285/563] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:17:22 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:17:22.747295 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-61b4eb08-544e-40db-8c5a-e5ec2f3d12be req-6530a9e1-6299-4ca6-a008-060f4acc2410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25192300-f22a-4b50-b390-17236f961eb5", "name": "network-vif-plugged", "status": "completed", "tag": "ea45359b-6df0-4bcb-9182-26e4cca9bdd6"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:17:22.758127 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-61b4eb08-544e-40db-8c5a-e5ec2f3d12be req-6530a9e1-6299-4ca6-a008-060f4acc2410 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:22.758605 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-61b4eb08-544e-40db-8c5a-e5ec2f3d12be req-6530a9e1-6299-4ca6-a008-060f4acc2410 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:22.759034 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-61b4eb08-544e-40db-8c5a-e5ec2f3d12be req-6530a9e1-6299-4ca6-a008-060f4acc2410 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:22.771463 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-61b4eb08-544e-40db-8c5a-e5ec2f3d12be req-6530a9e1-6299-4ca6-a008-060f4acc2410 service nova] Creating event network-vif-plugged:ea45359b-6df0-4bcb-9182-26e4cca9bdd6 for instance 25192300-f22a-4b50-b390-17236f961eb5 on hv-cinder-85236 Sep 04 16:17:22.776525 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-61b4eb08-544e-40db-8c5a-e5ec2f3d12be req-6530a9e1-6299-4ca6-a008-060f4acc2410 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033380 Sep 04 16:17:22.777169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 279/564] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:17:23.347494 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d1632985-3805-455b-8152-b8c6cf636058 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:23.349544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d1632985-3805-455b-8152-b8c6cf636058 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:23.356341 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1632985-3805-455b-8152-b8c6cf636058 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:23.356910 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1632985-3805-455b-8152-b8c6cf636058 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:23.357418 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1632985-3805-455b-8152-b8c6cf636058 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:23.358240 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1632985-3805-455b-8152-b8c6cf636058 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:23.358789 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1632985-3805-455b-8152-b8c6cf636058 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:23.359266 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1632985-3805-455b-8152-b8c6cf636058 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:23.513041 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d1632985-3805-455b-8152-b8c6cf636058 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:23.522969 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d1632985-3805-455b-8152-b8c6cf636058 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:23.525408 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d1632985-3805-455b-8152-b8c6cf636058 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:23.525601 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d1632985-3805-455b-8152-b8c6cf636058 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.182147 Sep 04 16:17:23.526260 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 286/565] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:17:23 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:17:24.554038 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4970744d-c45f-4c3b-9a61-7283bec2c294 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:24.554721 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4970744d-c45f-4c3b-9a61-7283bec2c294 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:24.560894 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4970744d-c45f-4c3b-9a61-7283bec2c294 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:24.561372 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4970744d-c45f-4c3b-9a61-7283bec2c294 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:24.561831 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4970744d-c45f-4c3b-9a61-7283bec2c294 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:24.562552 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4970744d-c45f-4c3b-9a61-7283bec2c294 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:24.562969 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4970744d-c45f-4c3b-9a61-7283bec2c294 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:24.563396 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4970744d-c45f-4c3b-9a61-7283bec2c294 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:24.706529 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4970744d-c45f-4c3b-9a61-7283bec2c294 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:24.715408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4970744d-c45f-4c3b-9a61-7283bec2c294 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:24.716870 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4970744d-c45f-4c3b-9a61-7283bec2c294 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:24.719988 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4970744d-c45f-4c3b-9a61-7283bec2c294 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.169434 Sep 04 16:17:24.719988 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 280/566] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:17:24 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:17:25.744436 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e982370e-e5ef-423f-9e19-9137545f89f6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:25.745384 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e982370e-e5ef-423f-9e19-9137545f89f6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:25.752482 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e982370e-e5ef-423f-9e19-9137545f89f6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:25.752718 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e982370e-e5ef-423f-9e19-9137545f89f6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:25.753224 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e982370e-e5ef-423f-9e19-9137545f89f6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:25.753945 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e982370e-e5ef-423f-9e19-9137545f89f6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:25.754433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e982370e-e5ef-423f-9e19-9137545f89f6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:25.755061 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e982370e-e5ef-423f-9e19-9137545f89f6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:25.888430 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e982370e-e5ef-423f-9e19-9137545f89f6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:25.895592 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e982370e-e5ef-423f-9e19-9137545f89f6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:25.897510 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e982370e-e5ef-423f-9e19-9137545f89f6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:25.898707 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e982370e-e5ef-423f-9e19-9137545f89f6 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.158154 Sep 04 16:17:25.899260 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 287/567] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:17:25 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:17:26.924658 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ffdec1fc-30ef-4413-9690-778b524b31b0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:26.925290 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ffdec1fc-30ef-4413-9690-778b524b31b0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:26.932506 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ffdec1fc-30ef-4413-9690-778b524b31b0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:26.932975 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ffdec1fc-30ef-4413-9690-778b524b31b0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:26.933403 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ffdec1fc-30ef-4413-9690-778b524b31b0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:26.934146 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ffdec1fc-30ef-4413-9690-778b524b31b0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:26.934589 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ffdec1fc-30ef-4413-9690-778b524b31b0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:26.935003 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ffdec1fc-30ef-4413-9690-778b524b31b0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:26.939246 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:17:27.068437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ffdec1fc-30ef-4413-9690-778b524b31b0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:27.077433 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ffdec1fc-30ef-4413-9690-778b524b31b0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:27.079093 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ffdec1fc-30ef-4413-9690-778b524b31b0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:27.080182 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ffdec1fc-30ef-4413-9690-778b524b31b0 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.159437 Sep 04 16:17:27.080739 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 281/568] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:17:26 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:17:28.106436 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2bc0a656-9f1c-456e-9a03-3b9157b9033b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:28.107030 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2bc0a656-9f1c-456e-9a03-3b9157b9033b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:28.114379 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2bc0a656-9f1c-456e-9a03-3b9157b9033b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:28.114864 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2bc0a656-9f1c-456e-9a03-3b9157b9033b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:28.115297 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2bc0a656-9f1c-456e-9a03-3b9157b9033b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:28.116024 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2bc0a656-9f1c-456e-9a03-3b9157b9033b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:28.116506 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2bc0a656-9f1c-456e-9a03-3b9157b9033b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:28.116928 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2bc0a656-9f1c-456e-9a03-3b9157b9033b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:28.254301 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2bc0a656-9f1c-456e-9a03-3b9157b9033b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:28.264230 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2bc0a656-9f1c-456e-9a03-3b9157b9033b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:28.269589 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2bc0a656-9f1c-456e-9a03-3b9157b9033b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:28.271075 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2bc0a656-9f1c-456e-9a03-3b9157b9033b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1808 microversion: 2.20 time: 0.168480 Sep 04 16:17:28.271637 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 288/569] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:17:28 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:17:29.298230 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-05cb6fe2-7b5b-49e1-82c0-df7a005f9389 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:29.298830 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-05cb6fe2-7b5b-49e1-82c0-df7a005f9389 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:29.306003 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-05cb6fe2-7b5b-49e1-82c0-df7a005f9389 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:29.306489 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-05cb6fe2-7b5b-49e1-82c0-df7a005f9389 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:29.307075 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-05cb6fe2-7b5b-49e1-82c0-df7a005f9389 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:29.307767 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-05cb6fe2-7b5b-49e1-82c0-df7a005f9389 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:29.308237 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-05cb6fe2-7b5b-49e1-82c0-df7a005f9389 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:29.308643 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-05cb6fe2-7b5b-49e1-82c0-df7a005f9389 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:29.442116 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-05cb6fe2-7b5b-49e1-82c0-df7a005f9389 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:29.450921 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-05cb6fe2-7b5b-49e1-82c0-df7a005f9389 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:29.452437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-05cb6fe2-7b5b-49e1-82c0-df7a005f9389 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:29.453611 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-05cb6fe2-7b5b-49e1-82c0-df7a005f9389 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1795 microversion: 2.20 time: 0.159171 Sep 04 16:17:29.454302 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 282/570] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:17:29 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1795 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:17:42.217877 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ed6dbc01-0a8d-4150-a842-b88498481fce tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:42.218398 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ed6dbc01-0a8d-4150-a842-b88498481fce tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:42.221123 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=68 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:17:42.221824 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:17:42.226464 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed6dbc01-0a8d-4150-a842-b88498481fce tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:42.226970 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed6dbc01-0a8d-4150-a842-b88498481fce tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:42.227405 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed6dbc01-0a8d-4150-a842-b88498481fce tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:42.229308 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed6dbc01-0a8d-4150-a842-b88498481fce tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:42.229924 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed6dbc01-0a8d-4150-a842-b88498481fce tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:42.230355 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed6dbc01-0a8d-4150-a842-b88498481fce tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:42.313234 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-ed6dbc01-0a8d-4150-a842-b88498481fce tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lazy-loading 'services' on Instance uuid ef119005-1210-4108-b0bd-98771fe1fa37 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:17:42.488883 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ed6dbc01-0a8d-4150-a842-b88498481fce tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37/os-volume_attachments/7a02c19d-3664-4fd3-9910-19553e509e41" status: 202 len: 0 microversion: 2.1 time: 0.274776 Sep 04 16:17:42.496076 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 289/571] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Sep 4 16:17:42 2022] DELETE /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37/os-volume_attachments/7a02c19d-3664-4fd3-9910-19553e509e41 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:17:44.685799 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-03a1c927-445a-405b-985b-c5b859ec1269 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:44.685799 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-03a1c927-445a-405b-985b-c5b859ec1269 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:44.688028 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=17 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:17:44.688716 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=10 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:17:44.695167 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03a1c927-445a-405b-985b-c5b859ec1269 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:44.696030 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03a1c927-445a-405b-985b-c5b859ec1269 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:44.696817 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03a1c927-445a-405b-985b-c5b859ec1269 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:44.698082 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03a1c927-445a-405b-985b-c5b859ec1269 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:44.698912 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03a1c927-445a-405b-985b-c5b859ec1269 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:44.699699 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03a1c927-445a-405b-985b-c5b859ec1269 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:44.727714 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-03a1c927-445a-405b-985b-c5b859ec1269 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 16:17:44.969863 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-03a1c927-445a-405b-985b-c5b859ec1269 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 204 len: 0 microversion: 2.1 time: 0.288877 Sep 04 16:17:44.970382 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 283/572] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:17:44 2022] DELETE /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 16:17:44.979767 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-96a901b9-28d2-491f-980c-bf79ff2a2908 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:44.980453 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-96a901b9-28d2-491f-980c-bf79ff2a2908 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:44.987508 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96a901b9-28d2-491f-980c-bf79ff2a2908 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:44.987978 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96a901b9-28d2-491f-980c-bf79ff2a2908 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:44.988401 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96a901b9-28d2-491f-980c-bf79ff2a2908 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:44.989081 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96a901b9-28d2-491f-980c-bf79ff2a2908 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:44.989650 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96a901b9-28d2-491f-980c-bf79ff2a2908 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:44.990066 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-96a901b9-28d2-491f-980c-bf79ff2a2908 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:45.122570 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-96a901b9-28d2-491f-980c-bf79ff2a2908 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:45.131768 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-96a901b9-28d2-491f-980c-bf79ff2a2908 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 200 len: 1513 microversion: 2.1 time: 0.156710 Sep 04 16:17:45.132327 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 290/573] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:44 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:46.155667 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-62e455a1-d9a3-46a0-93d7-818e93c94346 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:46.156355 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-62e455a1-d9a3-46a0-93d7-818e93c94346 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:46.162733 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62e455a1-d9a3-46a0-93d7-818e93c94346 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:46.163209 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62e455a1-d9a3-46a0-93d7-818e93c94346 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:46.163632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62e455a1-d9a3-46a0-93d7-818e93c94346 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:46.164311 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62e455a1-d9a3-46a0-93d7-818e93c94346 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:46.164756 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62e455a1-d9a3-46a0-93d7-818e93c94346 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:46.165173 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-62e455a1-d9a3-46a0-93d7-818e93c94346 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:46.298045 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-62e455a1-d9a3-46a0-93d7-818e93c94346 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:46.306592 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-62e455a1-d9a3-46a0-93d7-818e93c94346 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 200 len: 1513 microversion: 2.1 time: 0.155117 Sep 04 16:17:46.307141 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 284/574] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:46 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:47.330646 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ca499527-3513-4e76-a072-fef309b86d1f tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:47.331281 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ca499527-3513-4e76-a072-fef309b86d1f tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:47.337857 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca499527-3513-4e76-a072-fef309b86d1f tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:47.338340 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca499527-3513-4e76-a072-fef309b86d1f tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:47.338780 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca499527-3513-4e76-a072-fef309b86d1f tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:47.339475 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca499527-3513-4e76-a072-fef309b86d1f tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:47.339930 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca499527-3513-4e76-a072-fef309b86d1f tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:47.340354 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ca499527-3513-4e76-a072-fef309b86d1f tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:47.551295 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ca499527-3513-4e76-a072-fef309b86d1f tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:47.559706 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ca499527-3513-4e76-a072-fef309b86d1f tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 200 len: 1513 microversion: 2.1 time: 0.233761 Sep 04 16:17:47.561439 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 291/575] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:47 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 1513 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:47.993373 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-23b3eb15-ffa4-47e2-b9ab-878925fb707d req-4572fbdc-1a6a-4bae-b8f0-8db1e807fe0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef119005-1210-4108-b0bd-98771fe1fa37", "name": "network-vif-deleted", "tag": "4f0626e3-395a-4b67-9d54-2a5ea157dccc"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:17:48.004340 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-23b3eb15-ffa4-47e2-b9ab-878925fb707d req-4572fbdc-1a6a-4bae-b8f0-8db1e807fe0f service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:48.006752 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-23b3eb15-ffa4-47e2-b9ab-878925fb707d req-4572fbdc-1a6a-4bae-b8f0-8db1e807fe0f service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:48.006752 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-23b3eb15-ffa4-47e2-b9ab-878925fb707d req-4572fbdc-1a6a-4bae-b8f0-8db1e807fe0f service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:48.019819 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-23b3eb15-ffa4-47e2-b9ab-878925fb707d req-4572fbdc-1a6a-4bae-b8f0-8db1e807fe0f service nova] Creating event network-vif-deleted:4f0626e3-395a-4b67-9d54-2a5ea157dccc for instance ef119005-1210-4108-b0bd-98771fe1fa37 on hv-cinder-85236 Sep 04 16:17:48.032118 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-23b3eb15-ffa4-47e2-b9ab-878925fb707d req-4572fbdc-1a6a-4bae-b8f0-8db1e807fe0f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042084 Sep 04 16:17:48.032118 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 285/576] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:17:48.584054 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b859cb2f-5322-4d4f-8a9e-d46dcc41e033 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:48.584730 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b859cb2f-5322-4d4f-8a9e-d46dcc41e033 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:48.593159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b859cb2f-5322-4d4f-8a9e-d46dcc41e033 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:48.593700 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b859cb2f-5322-4d4f-8a9e-d46dcc41e033 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:48.594143 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b859cb2f-5322-4d4f-8a9e-d46dcc41e033 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:48.594979 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b859cb2f-5322-4d4f-8a9e-d46dcc41e033 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:48.595437 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b859cb2f-5322-4d4f-8a9e-d46dcc41e033 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:48.596081 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b859cb2f-5322-4d4f-8a9e-d46dcc41e033 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:48.629050 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b859cb2f-5322-4d4f-8a9e-d46dcc41e033 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:48.629531 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b859cb2f-5322-4d4f-8a9e-d46dcc41e033 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:48.629996 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b859cb2f-5322-4d4f-8a9e-d46dcc41e033 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:48.630441 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-b859cb2f-5322-4d4f-8a9e-d46dcc41e033 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lazy-loading 'fault' on Instance uuid ef119005-1210-4108-b0bd-98771fe1fa37 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:17:48.673837 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b859cb2f-5322-4d4f-8a9e-d46dcc41e033 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8925da59209424fbd6375f056aee752', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1ae25e634d4380a6933101fb94ad2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:17:48.681785 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b859cb2f-5322-4d4f-8a9e-d46dcc41e033 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 200 len: 1308 microversion: 2.1 time: 0.101580 Sep 04 16:17:48.682542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 292/577] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:48 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:17:49.710722 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-eaa77d8a-bb46-40b1-85c0-ee5eb5d0ade7 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:49.711372 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-eaa77d8a-bb46-40b1-85c0-ee5eb5d0ade7 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] [instance: ef119005-1210-4108-b0bd-98771fe1fa37] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:49.718358 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eaa77d8a-bb46-40b1-85c0-ee5eb5d0ade7 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:49.718835 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eaa77d8a-bb46-40b1-85c0-ee5eb5d0ade7 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:49.719276 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eaa77d8a-bb46-40b1-85c0-ee5eb5d0ade7 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:49.719997 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eaa77d8a-bb46-40b1-85c0-ee5eb5d0ade7 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:49.720450 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eaa77d8a-bb46-40b1-85c0-ee5eb5d0ade7 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:49.720875 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-eaa77d8a-bb46-40b1-85c0-ee5eb5d0ade7 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:49.734022 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-eaa77d8a-bb46-40b1-85c0-ee5eb5d0ade7 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] HTTP exception thrown: Instance ef119005-1210-4108-b0bd-98771fe1fa37 could not be found. Sep 04 16:17:49.735679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-eaa77d8a-bb46-40b1-85c0-ee5eb5d0ade7 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Request method failure captured: Sep 04 16:17:49.735679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 HTTP/1.1 Sep 04 16:17:49.735679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:17:49.735679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:17:49.735679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:17:49.735679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:17:49.735679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:17:49.735679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:17:49.735679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:17:49.735679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:17:49.735679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFM8DAuud37HmWIb8g9iDlcJupcamkFPjBB8j0qBtNyC65puv9f6DdNj7CP4wjXiNhavEN7H4V2sbNvmrtJGt-_9ax0YU2qjsGUghy73EIF_6vlc4nzLwKhuYQh6ADa1nvm97CMCVXDtBp3B20qoMrUuolPsXx0RcHgww4D3zoM0W4Bs Sep 04 16:17:49.735679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:17:49.735679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:17:49.735679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:17:49.735679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:17:49.735679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:17:49.735679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:17:49.735679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: 9f1ae25e634d4380a6933101fb94ad2e Sep 04 16:17:49.735679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1231968782 Sep 04 16:17:49.735679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:17:49.735679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:17:49.737231 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9f1ae25e634d4380a6933101fb94ad2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9f1ae25e634d4380a6933101fb94ad2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9f1ae25e634d4380a6933101fb94ad2e", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9f1ae25e634d4380a6933101fb94ad2e"}]}] Sep 04 16:17:49.737231 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-VolumesSnapshotTestJSON-1231968782 Sep 04 16:17:49.737231 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 9f1ae25e634d4380a6933101fb94ad2e Sep 04 16:17:49.737231 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1231968782 Sep 04 16:17:49.737231 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-VolumesSnapshotTestJSON-1231968782-project Sep 04 16:17:49.737231 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:17:49.737231 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:17:49.737231 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: a8925da59209424fbd6375f056aee752 Sep 04 16:17:49.737231 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-VolumesSnapshotTestJSON-1231968782-project Sep 04 16:17:49.737231 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: > Sep 04 16:17:49.737231 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Instance ef119005-1210-4108-b0bd-98771fe1fa37 could not be found. Sep 04 16:17:49.737231 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': 'ef119005-1210-4108-b0bd-98771fe1fa37'} Sep 04 16:17:49.738169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:17:49.738169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:17:49.738169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:17:49.738169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:17:49.738169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:17:49.738169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:17:49.738169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:17:49.738169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:17:49.738169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:17:49.738169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:17:49.738169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef119005-1210-4108-b0bd-98771fe1fa37 could not be found. Sep 04 16:17:49.738169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:17:49.738169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:17:49.738169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:17:49.738169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:17:49.738169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:17:49.738169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:17:49.738169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:17:49.738169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:17:49.738169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:17:49.739632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:17:49.739632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:17:49.739632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:17:49.739632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:17:49.739632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:17:49.739632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:17:49.739632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:17:49.739632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef119005-1210-4108-b0bd-98771fe1fa37 could not be found. Sep 04 16:17:49.739632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:17:49.739632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:17:49.739632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:17:49.739632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:17:49.739632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:17:49.739632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:17:49.739632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:17:49.739632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:17:49.739632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef119005-1210-4108-b0bd-98771fe1fa37 could not be found. Sep 04 16:17:49.739632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:17:49.741149 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-eaa77d8a-bb46-40b1-85c0-ee5eb5d0ade7 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] Returning 404 to user: Instance ef119005-1210-4108-b0bd-98771fe1fa37 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:17:49.741149 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-eaa77d8a-bb46-40b1-85c0-ee5eb5d0ade7 tempest-VolumesSnapshotTestJSON-1231968782 tempest-VolumesSnapshotTestJSON-1231968782-project] 10.222.0.39 "GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37" status: 404 len: 111 microversion: 2.1 time: 0.031320 Sep 04 16:17:49.741149 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 286/578] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:17:49 2022] GET /compute/v2.1/servers/ef119005-1210-4108-b0bd-98771fe1fa37 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:17:59.833996 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-781d09a8-d742-4b73-8744-db248a979f66 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:59.834831 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-781d09a8-d742-4b73-8744-db248a979f66 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:59.837482 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=10 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:17:59.838196 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:17:59.843864 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-781d09a8-d742-4b73-8744-db248a979f66 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:59.844428 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-781d09a8-d742-4b73-8744-db248a979f66 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:59.844859 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-781d09a8-d742-4b73-8744-db248a979f66 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:59.845553 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-781d09a8-d742-4b73-8744-db248a979f66 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:59.846023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-781d09a8-d742-4b73-8744-db248a979f66 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:59.847301 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-781d09a8-d742-4b73-8744-db248a979f66 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:59.873258 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-781d09a8-d742-4b73-8744-db248a979f66 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76/ips" status: 200 len: 151 microversion: 2.1 time: 0.044323 Sep 04 16:17:59.873837 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 293/579] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Sep 4 16:17:59 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:17:59.885467 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ec7c1516-af94-4ddd-8822-22c0cb9dcf3d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba1e282e-3e59-40b4-b0e5-e7fae00d1bb4"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:17:59.887821 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ec7c1516-af94-4ddd-8822-22c0cb9dcf3d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:17:59.890783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:17:59.891432 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:17:59.896454 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec7c1516-af94-4ddd-8822-22c0cb9dcf3d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:59.896935 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec7c1516-af94-4ddd-8822-22c0cb9dcf3d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:59.897363 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec7c1516-af94-4ddd-8822-22c0cb9dcf3d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:59.898069 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec7c1516-af94-4ddd-8822-22c0cb9dcf3d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:17:59.898566 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec7c1516-af94-4ddd-8822-22c0cb9dcf3d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:17:59.898986 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec7c1516-af94-4ddd-8822-22c0cb9dcf3d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:17:59.983757 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-ec7c1516-af94-4ddd-8822-22c0cb9dcf3d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] HTTP exception thrown: Invalid volume: volume ba1e282e-3e59-40b4-b0e5-e7fae00d1bb4 is already attached to instances: 449c2258-280e-405f-a3d1-498688a52529 Sep 04 16:17:59.985367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ec7c1516-af94-4ddd-8822-22c0cb9dcf3d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Request method failure captured: Sep 04 16:17:59.985367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: POST /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76/os-volume_attachments HTTP/1.1 Sep 04 16:17:59.985367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:17:59.985367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:17:59.985367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:17:59.985367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 74 Sep 04 16:17:59.985367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:17:59.985367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:17:59.985367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:17:59.985367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:17:59.985367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFM7CEjNpb-xR3hPJMPQ-wsTXSagT7BYEktfOgtljHhzvAeE20V1mpt42r1aF9sMAbjmPPVeaP94mwlrfyovEVPw6ArC_YpgCrCSBFtvcpj7IAtQcwG53eIdKr17VLDw7eStXYQicK9SnKgixnRa-ofn7JvVLgTmHvsJ-_KcGiq48xm4 Sep 04 16:17:59.985367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:17:59.985367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:17:59.985367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:17:59.985367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:17:59.985367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:17:59.985367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:17:59.985367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:17:59.985367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:17:59.985367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:17:59.985367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:17:59.987036 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1cc5ea4158344d5c8a35bc5783410620", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}] Sep 04 16:17:59.987036 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:17:59.987036 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:17:59.987036 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:17:59.987036 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:17:59.987036 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:17:59.987036 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:17:59.987036 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: 6e5c22b631df4600b9f920120b67fc67 Sep 04 16:17:59.987036 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:17:59.987036 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Sep 04 16:17:59.987036 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {"volumeAttachment": {"volumeId": "ba1e282e-3e59-40b4-b0e5-e7fae00d1bb4"}} Sep 04 16:17:59.987036 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: > Sep 04 16:17:59.988459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Invalid volume: volume ba1e282e-3e59-40b4-b0e5-e7fae00d1bb4 is already attached to instances: 449c2258-280e-405f-a3d1-498688a52529 Sep 04 16:17:59.988459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'server_id': '512e46e1-9291-44b3-b609-c1147f105f76', 'body': {'volumeAttachment': {'volumeId': 'ba1e282e-3e59-40b4-b0e5-e7fae00d1bb4'}}} Sep 04 16:17:59.988459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:17:59.988459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:17:59.988459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 04 16:17:59.988459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 04 16:17:59.988459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 04 16:17:59.988459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 04 16:17:59.988459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 04 16:17:59.988459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 04 16:17:59.988459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 04 16:17:59.988459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 04 16:17:59.988459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 04 16:17:59.988459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 04 16:17:59.988459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ba1e282e-3e59-40b4-b0e5-e7fae00d1bb4 is already attached to instances: 449c2258-280e-405f-a3d1-498688a52529 Sep 04 16:17:59.988459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:17:59.988459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:17:59.988459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:17:59.988459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:17:59.990142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:17:59.990142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:17:59.990142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:17:59.990142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:17:59.990142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:17:59.990142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:17:59.990142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 04 16:17:59.990142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 04 16:17:59.990142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 04 16:17:59.990142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 04 16:17:59.990142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 04 16:17:59.990142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 04 16:17:59.990142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 04 16:17:59.990142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 04 16:17:59.990142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ba1e282e-3e59-40b4-b0e5-e7fae00d1bb4 is already attached to instances: 449c2258-280e-405f-a3d1-498688a52529 Sep 04 16:17:59.990142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:17:59.990142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:17:59.990142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:17:59.990142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:17:59.990142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:17:59.991677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:17:59.991677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:17:59.991677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:17:59.991677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ba1e282e-3e59-40b4-b0e5-e7fae00d1bb4 is already attached to instances: 449c2258-280e-405f-a3d1-498688a52529 Sep 04 16:17:59.991677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:17:59.991677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ec7c1516-af94-4ddd-8822-22c0cb9dcf3d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Returning 400 to user: Invalid volume: volume ba1e282e-3e59-40b4-b0e5-e7fae00d1bb4 is already attached to instances: 449c2258-280e-405f-a3d1-498688a52529 {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:17:59.991677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ec7c1516-af94-4ddd-8822-22c0cb9dcf3d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "POST /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105452 Sep 04 16:17:59.991677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 287/580] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Sep 4 16:17:59 2022] POST /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 04 16:17:59.997355 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cec2b648-ec0f-4771-9764-43713dda1daf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:17:59.997913 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cec2b648-ec0f-4771-9764-43713dda1daf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:00.004785 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cec2b648-ec0f-4771-9764-43713dda1daf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:00.005262 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cec2b648-ec0f-4771-9764-43713dda1daf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:00.005722 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cec2b648-ec0f-4771-9764-43713dda1daf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:00.006402 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cec2b648-ec0f-4771-9764-43713dda1daf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:00.006848 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cec2b648-ec0f-4771-9764-43713dda1daf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:00.007265 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cec2b648-ec0f-4771-9764-43713dda1daf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:00.033727 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cec2b648-ec0f-4771-9764-43713dda1daf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 16:18:00.256173 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cec2b648-ec0f-4771-9764-43713dda1daf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "DELETE /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 204 len: 0 microversion: 2.1 time: 0.263189 Sep 04 16:18:00.256964 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 294/581] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:17:59 2022] DELETE /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 16:18:00.266084 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-34b19ebf-0c6f-476e-b6dc-ee86ab171bd1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:00.266980 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-34b19ebf-0c6f-476e-b6dc-ee86ab171bd1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:00.277081 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-34b19ebf-0c6f-476e-b6dc-ee86ab171bd1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:00.277896 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-34b19ebf-0c6f-476e-b6dc-ee86ab171bd1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:00.278690 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-34b19ebf-0c6f-476e-b6dc-ee86ab171bd1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:00.279639 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-34b19ebf-0c6f-476e-b6dc-ee86ab171bd1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:00.280394 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-34b19ebf-0c6f-476e-b6dc-ee86ab171bd1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:00.280987 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-34b19ebf-0c6f-476e-b6dc-ee86ab171bd1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:00.437248 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-34b19ebf-0c6f-476e-b6dc-ee86ab171bd1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:00.446156 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-34b19ebf-0c6f-476e-b6dc-ee86ab171bd1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1684 microversion: 2.1 time: 0.184789 Sep 04 16:18:00.446727 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 288/582] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:00 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1684 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:01.470949 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5786993c-9913-4ec3-a2cf-8af4fd656388 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:01.472176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5786993c-9913-4ec3-a2cf-8af4fd656388 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:01.478508 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5786993c-9913-4ec3-a2cf-8af4fd656388 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:01.478982 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5786993c-9913-4ec3-a2cf-8af4fd656388 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:01.479411 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5786993c-9913-4ec3-a2cf-8af4fd656388 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:01.480095 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5786993c-9913-4ec3-a2cf-8af4fd656388 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:01.480533 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5786993c-9913-4ec3-a2cf-8af4fd656388 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:01.480947 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5786993c-9913-4ec3-a2cf-8af4fd656388 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:01.609277 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5786993c-9913-4ec3-a2cf-8af4fd656388 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:01.617913 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5786993c-9913-4ec3-a2cf-8af4fd656388 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1684 microversion: 2.1 time: 0.151121 Sep 04 16:18:01.618520 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 295/583] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:01 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:02.642973 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-39398ca1-4536-44bf-a2bd-4a9c26c30aad tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:02.644105 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-39398ca1-4536-44bf-a2bd-4a9c26c30aad tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:02.650552 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-39398ca1-4536-44bf-a2bd-4a9c26c30aad tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:02.651025 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-39398ca1-4536-44bf-a2bd-4a9c26c30aad tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:02.651451 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-39398ca1-4536-44bf-a2bd-4a9c26c30aad tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:02.652136 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-39398ca1-4536-44bf-a2bd-4a9c26c30aad tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:02.652577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-39398ca1-4536-44bf-a2bd-4a9c26c30aad tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:02.652992 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-39398ca1-4536-44bf-a2bd-4a9c26c30aad tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:02.796327 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-39398ca1-4536-44bf-a2bd-4a9c26c30aad tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:02.803973 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-39398ca1-4536-44bf-a2bd-4a9c26c30aad tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1684 microversion: 2.1 time: 0.165377 Sep 04 16:18:02.804536 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 289/584] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:02 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:03.827504 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c8517842-2aa8-4baf-b30c-73b95516aef5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:03.828131 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c8517842-2aa8-4baf-b30c-73b95516aef5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:03.835068 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8517842-2aa8-4baf-b30c-73b95516aef5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:03.835544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8517842-2aa8-4baf-b30c-73b95516aef5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:03.835974 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8517842-2aa8-4baf-b30c-73b95516aef5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:03.836653 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8517842-2aa8-4baf-b30c-73b95516aef5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:03.837103 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8517842-2aa8-4baf-b30c-73b95516aef5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:03.837519 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c8517842-2aa8-4baf-b30c-73b95516aef5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:03.964313 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c8517842-2aa8-4baf-b30c-73b95516aef5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:03.971979 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c8517842-2aa8-4baf-b30c-73b95516aef5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1684 microversion: 2.1 time: 0.148244 Sep 04 16:18:03.972535 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 296/585] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:03 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1684 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:04.995649 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-163e9ec0-241f-4047-9fd7-257cc3b98714 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:04.996260 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-163e9ec0-241f-4047-9fd7-257cc3b98714 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:05.004314 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-163e9ec0-241f-4047-9fd7-257cc3b98714 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:05.004821 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-163e9ec0-241f-4047-9fd7-257cc3b98714 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:05.005256 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-163e9ec0-241f-4047-9fd7-257cc3b98714 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:05.005978 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-163e9ec0-241f-4047-9fd7-257cc3b98714 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:05.006431 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-163e9ec0-241f-4047-9fd7-257cc3b98714 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:05.006850 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-163e9ec0-241f-4047-9fd7-257cc3b98714 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:05.184251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-163e9ec0-241f-4047-9fd7-257cc3b98714 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:05.193375 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-163e9ec0-241f-4047-9fd7-257cc3b98714 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1684 microversion: 2.1 time: 0.201548 Sep 04 16:18:05.194055 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 290/586] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:04 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1684 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:05.545326 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-23bd958b-f31d-4980-9b1d-97f84b4d4e4e req-30897995-f54f-436a-869d-37bd32c86ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "512e46e1-9291-44b3-b609-c1147f105f76", "name": "network-vif-deleted", "tag": "08dc8012-7cf0-4bba-b537-c92a01bb802d"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:18:05.556584 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-23bd958b-f31d-4980-9b1d-97f84b4d4e4e req-30897995-f54f-436a-869d-37bd32c86ef2 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:05.557068 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-23bd958b-f31d-4980-9b1d-97f84b4d4e4e req-30897995-f54f-436a-869d-37bd32c86ef2 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:05.557726 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-23bd958b-f31d-4980-9b1d-97f84b4d4e4e req-30897995-f54f-436a-869d-37bd32c86ef2 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:05.574329 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-23bd958b-f31d-4980-9b1d-97f84b4d4e4e req-30897995-f54f-436a-869d-37bd32c86ef2 service nova] Creating event network-vif-deleted:08dc8012-7cf0-4bba-b537-c92a01bb802d for instance 512e46e1-9291-44b3-b609-c1147f105f76 on hv-cinder-85236 Sep 04 16:18:05.579919 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-23bd958b-f31d-4980-9b1d-97f84b4d4e4e req-30897995-f54f-436a-869d-37bd32c86ef2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038033 Sep 04 16:18:05.583825 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 297/587] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:18:06.218019 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-793d0ed3-201b-4210-a72b-1ae47ed15b4e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:06.219520 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-793d0ed3-201b-4210-a72b-1ae47ed15b4e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:06.232472 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-793d0ed3-201b-4210-a72b-1ae47ed15b4e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:06.232472 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-793d0ed3-201b-4210-a72b-1ae47ed15b4e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:06.232472 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-793d0ed3-201b-4210-a72b-1ae47ed15b4e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:06.232472 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-793d0ed3-201b-4210-a72b-1ae47ed15b4e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:06.233102 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-793d0ed3-201b-4210-a72b-1ae47ed15b4e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:06.233102 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-793d0ed3-201b-4210-a72b-1ae47ed15b4e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:06.264495 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-793d0ed3-201b-4210-a72b-1ae47ed15b4e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:06.265724 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-793d0ed3-201b-4210-a72b-1ae47ed15b4e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:06.266309 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-793d0ed3-201b-4210-a72b-1ae47ed15b4e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:06.266926 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-793d0ed3-201b-4210-a72b-1ae47ed15b4e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lazy-loading 'fault' on Instance uuid 512e46e1-9291-44b3-b609-c1147f105f76 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:18:06.312104 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-793d0ed3-201b-4210-a72b-1ae47ed15b4e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:06.320836 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-793d0ed3-201b-4210-a72b-1ae47ed15b4e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1332 microversion: 2.1 time: 0.106563 Sep 04 16:18:06.334690 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 291/588] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:06 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1332 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:07.349474 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f4e15d6f-b668-43df-80f4-a729101b3f8e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:07.350297 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f4e15d6f-b668-43df-80f4-a729101b3f8e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:07.356990 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4e15d6f-b668-43df-80f4-a729101b3f8e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:07.357463 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4e15d6f-b668-43df-80f4-a729101b3f8e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:07.357931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4e15d6f-b668-43df-80f4-a729101b3f8e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:07.358608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4e15d6f-b668-43df-80f4-a729101b3f8e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:07.359057 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4e15d6f-b668-43df-80f4-a729101b3f8e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:07.359520 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4e15d6f-b668-43df-80f4-a729101b3f8e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:07.393624 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4e15d6f-b668-43df-80f4-a729101b3f8e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:07.394471 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4e15d6f-b668-43df-80f4-a729101b3f8e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:07.394911 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f4e15d6f-b668-43df-80f4-a729101b3f8e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:07.395359 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-f4e15d6f-b668-43df-80f4-a729101b3f8e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lazy-loading 'fault' on Instance uuid 512e46e1-9291-44b3-b609-c1147f105f76 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:18:07.450456 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f4e15d6f-b668-43df-80f4-a729101b3f8e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:07.459197 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f4e15d6f-b668-43df-80f4-a729101b3f8e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1332 microversion: 2.1 time: 0.114271 Sep 04 16:18:07.459785 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 298/589] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:07 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1332 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:08.482101 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e5bb3a14-f109-41e4-9594-d52f6c050791 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:08.482710 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e5bb3a14-f109-41e4-9594-d52f6c050791 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:08.489243 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e5bb3a14-f109-41e4-9594-d52f6c050791 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:08.489751 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e5bb3a14-f109-41e4-9594-d52f6c050791 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:08.490188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e5bb3a14-f109-41e4-9594-d52f6c050791 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:08.490868 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e5bb3a14-f109-41e4-9594-d52f6c050791 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:08.491325 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e5bb3a14-f109-41e4-9594-d52f6c050791 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:08.491745 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e5bb3a14-f109-41e4-9594-d52f6c050791 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:08.523287 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e5bb3a14-f109-41e4-9594-d52f6c050791 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:08.523760 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e5bb3a14-f109-41e4-9594-d52f6c050791 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:08.524193 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e5bb3a14-f109-41e4-9594-d52f6c050791 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:08.524631 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-e5bb3a14-f109-41e4-9594-d52f6c050791 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lazy-loading 'fault' on Instance uuid 512e46e1-9291-44b3-b609-c1147f105f76 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:18:08.535415 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c6f16a4f-0d93-4b63-9268-cb9e3c693a24 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80716f97-c736-4682-bf4f-b71c2ee354bf"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:18:08.537869 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c6f16a4f-0d93-4b63-9268-cb9e3c693a24 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:08.544494 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6f16a4f-0d93-4b63-9268-cb9e3c693a24 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:08.545025 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6f16a4f-0d93-4b63-9268-cb9e3c693a24 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:08.545457 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6f16a4f-0d93-4b63-9268-cb9e3c693a24 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:08.546177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6f16a4f-0d93-4b63-9268-cb9e3c693a24 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:08.546631 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6f16a4f-0d93-4b63-9268-cb9e3c693a24 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:08.547115 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c6f16a4f-0d93-4b63-9268-cb9e3c693a24 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:08.568570 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e5bb3a14-f109-41e4-9594-d52f6c050791 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:08.576543 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e5bb3a14-f109-41e4-9594-d52f6c050791 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 200 len: 1332 microversion: 2.1 time: 0.098082 Sep 04 16:18:08.577113 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 292/590] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:08 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:09.600146 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-101e2628-27cd-4322-94b2-d0da1ccf63be tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:09.600761 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-101e2628-27cd-4322-94b2-d0da1ccf63be tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:09.607429 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-101e2628-27cd-4322-94b2-d0da1ccf63be tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:09.607940 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-101e2628-27cd-4322-94b2-d0da1ccf63be tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:09.608366 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-101e2628-27cd-4322-94b2-d0da1ccf63be tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:09.609098 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-101e2628-27cd-4322-94b2-d0da1ccf63be tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:09.609587 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-101e2628-27cd-4322-94b2-d0da1ccf63be tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:09.610013 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-101e2628-27cd-4322-94b2-d0da1ccf63be tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:09.624010 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-101e2628-27cd-4322-94b2-d0da1ccf63be tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] HTTP exception thrown: Instance 512e46e1-9291-44b3-b609-c1147f105f76 could not be found. Sep 04 16:18:09.625505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-101e2628-27cd-4322-94b2-d0da1ccf63be tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Request method failure captured: Sep 04 16:18:09.625505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 HTTP/1.1 Sep 04 16:18:09.625505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:18:09.625505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:18:09.625505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:18:09.625505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:18:09.625505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:18:09.625505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:18:09.625505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:18:09.625505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:18:09.625505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFM7CEjNpb-xR3hPJMPQ-wsTXSagT7BYEktfOgtljHhzvAeE20V1mpt42r1aF9sMAbjmPPVeaP94mwlrfyovEVPw6ArC_YpgCrCSBFtvcpj7IAtQcwG53eIdKr17VLDw7eStXYQicK9SnKgixnRa-ofn7JvVLgTmHvsJ-_KcGiq48xm4 Sep 04 16:18:09.625505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:18:09.625505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:18:09.625505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:18:09.625505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:18:09.625505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:18:09.625505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:18:09.625505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:18:09.625505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:18:09.625505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:18:09.625505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:18:09.627055 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1cc5ea4158344d5c8a35bc5783410620", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}] Sep 04 16:18:09.627055 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:18:09.627055 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:18:09.627055 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:18:09.627055 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:18:09.627055 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:18:09.627055 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:18:09.627055 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: 6e5c22b631df4600b9f920120b67fc67 Sep 04 16:18:09.627055 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:18:09.627055 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: > Sep 04 16:18:09.627055 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Instance 512e46e1-9291-44b3-b609-c1147f105f76 could not be found. Sep 04 16:18:09.627055 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': '512e46e1-9291-44b3-b609-c1147f105f76'} Sep 04 16:18:09.628679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:18:09.628679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:18:09.628679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:18:09.628679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:18:09.628679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:18:09.628679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:18:09.628679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:18:09.628679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:18:09.628679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:18:09.628679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:18:09.628679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 512e46e1-9291-44b3-b609-c1147f105f76 could not be found. Sep 04 16:18:09.628679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:18:09.628679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:18:09.628679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:18:09.628679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:18:09.628679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:18:09.628679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:18:09.628679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:18:09.628679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:18:09.628679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:18:09.630500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:18:09.630500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:18:09.630500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:18:09.630500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:18:09.630500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:18:09.630500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:18:09.630500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:18:09.630500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 512e46e1-9291-44b3-b609-c1147f105f76 could not be found. Sep 04 16:18:09.630500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:18:09.630500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:18:09.630500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:18:09.630500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:18:09.630500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:18:09.630500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:18:09.630500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:18:09.630500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:18:09.630500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 512e46e1-9291-44b3-b609-c1147f105f76 could not be found. Sep 04 16:18:09.630500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:18:09.631960 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-101e2628-27cd-4322-94b2-d0da1ccf63be tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Returning 404 to user: Instance 512e46e1-9291-44b3-b609-c1147f105f76 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:18:09.631960 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-101e2628-27cd-4322-94b2-d0da1ccf63be tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 404 len: 111 microversion: 2.1 time: 0.031106 Sep 04 16:18:09.631960 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 293/591] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:09 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 04 16:18:09.636324 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-54c1ec76-8bf8-4ae2-b1b1-fef58b9ecd4c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '.version_select at 0x7f968932b3a0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:09.731272 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-54c1ec76-8bf8-4ae2-b1b1-fef58b9ecd4c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1105122954" status: 202 len: 0 microversion: 2.1 time: 0.098554 Sep 04 16:18:09.731867 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 294/592] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Sep 4 16:18:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1105122954 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:18:09.751781 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c6f16a4f-0d93-4b63-9268-cb9e3c693a24 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "POST /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.220290 Sep 04 16:18:09.758723 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 299/593] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Sep 4 16:18:08 2022] POST /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d/os-volume_attachments => generated 194 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:18:11.047849 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0ad168e8-6def-47f3-98a0-b9945afc55d2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:11.048460 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0ad168e8-6def-47f3-98a0-b9945afc55d2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:11.058012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ad168e8-6def-47f3-98a0-b9945afc55d2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:11.058012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ad168e8-6def-47f3-98a0-b9945afc55d2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:11.058012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ad168e8-6def-47f3-98a0-b9945afc55d2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:11.058012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ad168e8-6def-47f3-98a0-b9945afc55d2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:11.058466 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ad168e8-6def-47f3-98a0-b9945afc55d2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:11.058466 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ad168e8-6def-47f3-98a0-b9945afc55d2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:11.199007 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-0ad168e8-6def-47f3-98a0-b9945afc55d2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lazy-loading 'services' on Instance uuid 449c2258-280e-405f-a3d1-498688a52529 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:18:11.432811 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0ad168e8-6def-47f3-98a0-b9945afc55d2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "DELETE /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments/ba1e282e-3e59-40b4-b0e5-e7fae00d1bb4" status: 202 len: 0 microversion: 2.1 time: 0.391957 Sep 04 16:18:11.433465 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 295/594] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Sep 4 16:18:11 2022] DELETE /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments/ba1e282e-3e59-40b4-b0e5-e7fae00d1bb4 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:18:11.454999 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b98bd45f-c9e4-4724-b383-6d07c8e3b1ab tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:11.454999 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b98bd45f-c9e4-4724-b383-6d07c8e3b1ab tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:11.454999 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b98bd45f-c9e4-4724-b383-6d07c8e3b1ab tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:11.454999 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b98bd45f-c9e4-4724-b383-6d07c8e3b1ab tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:11.455698 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b98bd45f-c9e4-4724-b383-6d07c8e3b1ab tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:11.455698 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b98bd45f-c9e4-4724-b383-6d07c8e3b1ab tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:11.455698 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b98bd45f-c9e4-4724-b383-6d07c8e3b1ab tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:11.456570 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b98bd45f-c9e4-4724-b383-6d07c8e3b1ab tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:11.488973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b98bd45f-c9e4-4724-b383-6d07c8e3b1ab tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050830 Sep 04 16:18:11.489534 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 300/595] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:18:11 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:18:12.506342 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cb2ffc10-e9eb-4926-9aa8-6a99a9bd3997 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:12.508616 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cb2ffc10-e9eb-4926-9aa8-6a99a9bd3997 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:12.514886 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cb2ffc10-e9eb-4926-9aa8-6a99a9bd3997 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:12.515362 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cb2ffc10-e9eb-4926-9aa8-6a99a9bd3997 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:12.516053 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cb2ffc10-e9eb-4926-9aa8-6a99a9bd3997 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:12.516859 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cb2ffc10-e9eb-4926-9aa8-6a99a9bd3997 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:12.517329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cb2ffc10-e9eb-4926-9aa8-6a99a9bd3997 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:12.517776 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cb2ffc10-e9eb-4926-9aa8-6a99a9bd3997 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:12.550877 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cb2ffc10-e9eb-4926-9aa8-6a99a9bd3997 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048697 Sep 04 16:18:12.550877 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 296/596] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:18:12 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:18:13.564565 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-065a99f1-f7a6-455e-82aa-22cd9c65cbb9 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:13.566702 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-065a99f1-f7a6-455e-82aa-22cd9c65cbb9 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:13.573661 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-065a99f1-f7a6-455e-82aa-22cd9c65cbb9 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:13.574139 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-065a99f1-f7a6-455e-82aa-22cd9c65cbb9 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:13.574572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-065a99f1-f7a6-455e-82aa-22cd9c65cbb9 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:13.575254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-065a99f1-f7a6-455e-82aa-22cd9c65cbb9 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:13.575701 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-065a99f1-f7a6-455e-82aa-22cd9c65cbb9 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:13.576117 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-065a99f1-f7a6-455e-82aa-22cd9c65cbb9 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:13.608030 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-065a99f1-f7a6-455e-82aa-22cd9c65cbb9 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047461 Sep 04 16:18:13.608589 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 301/597] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:18:13 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:18:14.621203 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-26027c73-0f97-4972-899c-6fe065ba1ffc tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:14.623349 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-26027c73-0f97-4972-899c-6fe065ba1ffc tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:14.629877 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26027c73-0f97-4972-899c-6fe065ba1ffc tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:14.630364 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26027c73-0f97-4972-899c-6fe065ba1ffc tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:14.630913 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26027c73-0f97-4972-899c-6fe065ba1ffc tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:14.631968 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26027c73-0f97-4972-899c-6fe065ba1ffc tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:14.632490 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26027c73-0f97-4972-899c-6fe065ba1ffc tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:14.632924 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26027c73-0f97-4972-899c-6fe065ba1ffc tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:14.664392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-26027c73-0f97-4972-899c-6fe065ba1ffc tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047135 Sep 04 16:18:14.664949 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 297/598] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:18:14 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:18:15.678610 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5186c358-47a2-4fbb-8357-cbac28f8d289 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:15.681392 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5186c358-47a2-4fbb-8357-cbac28f8d289 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:15.688430 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5186c358-47a2-4fbb-8357-cbac28f8d289 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:15.688905 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5186c358-47a2-4fbb-8357-cbac28f8d289 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:15.689331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5186c358-47a2-4fbb-8357-cbac28f8d289 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:15.690076 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5186c358-47a2-4fbb-8357-cbac28f8d289 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:15.690516 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5186c358-47a2-4fbb-8357-cbac28f8d289 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:15.690929 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5186c358-47a2-4fbb-8357-cbac28f8d289 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:15.722658 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5186c358-47a2-4fbb-8357-cbac28f8d289 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048226 Sep 04 16:18:15.726770 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 302/599] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:18:15 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:18:16.736921 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5de86511-6308-4a62-bac6-41cb188b33b3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:16.739101 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5de86511-6308-4a62-bac6-41cb188b33b3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:16.745539 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5de86511-6308-4a62-bac6-41cb188b33b3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:16.746044 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5de86511-6308-4a62-bac6-41cb188b33b3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:16.746472 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5de86511-6308-4a62-bac6-41cb188b33b3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:16.747145 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5de86511-6308-4a62-bac6-41cb188b33b3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:16.747588 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5de86511-6308-4a62-bac6-41cb188b33b3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:16.748000 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5de86511-6308-4a62-bac6-41cb188b33b3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:16.778295 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5de86511-6308-4a62-bac6-41cb188b33b3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045273 Sep 04 16:18:16.778760 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 298/600] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:18:16 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:18:17.790002 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-324b948c-1b17-44a9-a6e7-f2146a8d55c2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:17.792249 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-324b948c-1b17-44a9-a6e7-f2146a8d55c2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:17.798765 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-324b948c-1b17-44a9-a6e7-f2146a8d55c2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:17.799252 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-324b948c-1b17-44a9-a6e7-f2146a8d55c2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:17.799689 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-324b948c-1b17-44a9-a6e7-f2146a8d55c2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:17.800387 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-324b948c-1b17-44a9-a6e7-f2146a8d55c2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:17.800839 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-324b948c-1b17-44a9-a6e7-f2146a8d55c2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:17.801262 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-324b948c-1b17-44a9-a6e7-f2146a8d55c2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:17.832818 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-324b948c-1b17-44a9-a6e7-f2146a8d55c2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046820 Sep 04 16:18:17.833513 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 303/601] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:18:17 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:18:18.845609 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a535dcf9-7751-463f-ba5c-9d31af980e90 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:18.851976 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a535dcf9-7751-463f-ba5c-9d31af980e90 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:18.855368 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a535dcf9-7751-463f-ba5c-9d31af980e90 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:18.856267 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a535dcf9-7751-463f-ba5c-9d31af980e90 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:18.856714 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a535dcf9-7751-463f-ba5c-9d31af980e90 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:18.857418 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a535dcf9-7751-463f-ba5c-9d31af980e90 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:18.857901 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a535dcf9-7751-463f-ba5c-9d31af980e90 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:18.858334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a535dcf9-7751-463f-ba5c-9d31af980e90 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:18.889775 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a535dcf9-7751-463f-ba5c-9d31af980e90 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048099 Sep 04 16:18:18.890450 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 299/602] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:18:18 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:18:19.903408 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-235a0ea5-c2dd-4c31-afc8-c6bd84107e89 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:19.905491 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-235a0ea5-c2dd-4c31-afc8-c6bd84107e89 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:19.911871 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-235a0ea5-c2dd-4c31-afc8-c6bd84107e89 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:19.912348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-235a0ea5-c2dd-4c31-afc8-c6bd84107e89 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:19.912769 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-235a0ea5-c2dd-4c31-afc8-c6bd84107e89 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:19.913456 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-235a0ea5-c2dd-4c31-afc8-c6bd84107e89 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:19.913921 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-235a0ea5-c2dd-4c31-afc8-c6bd84107e89 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:19.914967 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-235a0ea5-c2dd-4c31-afc8-c6bd84107e89 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:19.945639 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-235a0ea5-c2dd-4c31-afc8-c6bd84107e89 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046807 Sep 04 16:18:19.946569 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 304/603] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:18:19 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:18:20.793046 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-159d0989-bcf7-4017-9a58-7047113bbdda tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:20.793679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-159d0989-bcf7-4017-9a58-7047113bbdda tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:20.799886 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-159d0989-bcf7-4017-9a58-7047113bbdda tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:20.800357 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-159d0989-bcf7-4017-9a58-7047113bbdda tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:20.800787 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-159d0989-bcf7-4017-9a58-7047113bbdda tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:20.801459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-159d0989-bcf7-4017-9a58-7047113bbdda tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:20.801970 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-159d0989-bcf7-4017-9a58-7047113bbdda tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:20.802392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-159d0989-bcf7-4017-9a58-7047113bbdda tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:20.831472 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-159d0989-bcf7-4017-9a58-7047113bbdda tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-volume_attachments/5f6c3a21-9f28-4890-ad74-769626740457" status: 200 len: 194 microversion: 2.20 time: 0.042596 Sep 04 16:18:20.832051 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 300/604] 10.222.0.39 () {60 vars in 1454 bytes} [Sun Sep 4 16:18:20 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-volume_attachments/5f6c3a21-9f28-4890-ad74-769626740457 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:18:20.909457 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1627e0ff-4f8b-4131-9e2e-6e7bee70725b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:20.910038 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1627e0ff-4f8b-4131-9e2e-6e7bee70725b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:20.916720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1627e0ff-4f8b-4131-9e2e-6e7bee70725b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:20.917283 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1627e0ff-4f8b-4131-9e2e-6e7bee70725b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:20.917735 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1627e0ff-4f8b-4131-9e2e-6e7bee70725b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:20.918797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1627e0ff-4f8b-4131-9e2e-6e7bee70725b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:20.919261 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1627e0ff-4f8b-4131-9e2e-6e7bee70725b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:20.919683 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1627e0ff-4f8b-4131-9e2e-6e7bee70725b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:20.957958 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-658cc491-2aa1-4066-b435-c436f72636d0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:20.961009 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-658cc491-2aa1-4066-b435-c436f72636d0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:20.966994 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-658cc491-2aa1-4066-b435-c436f72636d0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:20.967687 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-658cc491-2aa1-4066-b435-c436f72636d0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:20.968256 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-658cc491-2aa1-4066-b435-c436f72636d0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:20.969098 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-658cc491-2aa1-4066-b435-c436f72636d0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:20.969736 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-658cc491-2aa1-4066-b435-c436f72636d0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:20.970149 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-658cc491-2aa1-4066-b435-c436f72636d0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:21.007645 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-658cc491-2aa1-4066-b435-c436f72636d0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053417 Sep 04 16:18:21.012410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 301/605] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:18:20 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:18:21.023459 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-1627e0ff-4f8b-4131-9e2e-6e7bee70725b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lazy-loading 'services' on Instance uuid 25192300-f22a-4b50-b390-17236f961eb5 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:18:21.278830 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1627e0ff-4f8b-4131-9e2e-6e7bee70725b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "DELETE /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-volume_attachments/5f6c3a21-9f28-4890-ad74-769626740457" status: 202 len: 0 microversion: 2.20 time: 0.375120 Sep 04 16:18:21.280329 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 305/606] 10.222.0.39 () {60 vars in 1457 bytes} [Sun Sep 4 16:18:20 2022] DELETE /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-volume_attachments/5f6c3a21-9f28-4890-ad74-769626740457 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 04 16:18:21.289031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c2cb089c-953e-4ca0-873c-dee3afed59a2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:21.292459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c2cb089c-953e-4ca0-873c-dee3afed59a2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:21.298770 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c2cb089c-953e-4ca0-873c-dee3afed59a2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:21.299594 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c2cb089c-953e-4ca0-873c-dee3afed59a2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:21.299755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c2cb089c-953e-4ca0-873c-dee3afed59a2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:21.300816 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c2cb089c-953e-4ca0-873c-dee3afed59a2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:21.301281 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c2cb089c-953e-4ca0-873c-dee3afed59a2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:21.301739 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c2cb089c-953e-4ca0-873c-dee3afed59a2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:21.334179 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c2cb089c-953e-4ca0-873c-dee3afed59a2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049124 Sep 04 16:18:21.338473 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 302/607] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Sep 4 16:18:21 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:18:22.025322 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7245ec0f-80fb-46e0-a1a3-6284c2c562cf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:22.029065 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7245ec0f-80fb-46e0-a1a3-6284c2c562cf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:22.036234 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7245ec0f-80fb-46e0-a1a3-6284c2c562cf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:22.036967 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7245ec0f-80fb-46e0-a1a3-6284c2c562cf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:22.037619 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7245ec0f-80fb-46e0-a1a3-6284c2c562cf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:22.038478 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7245ec0f-80fb-46e0-a1a3-6284c2c562cf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:22.039130 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7245ec0f-80fb-46e0-a1a3-6284c2c562cf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:22.040288 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7245ec0f-80fb-46e0-a1a3-6284c2c562cf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:22.064822 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:18:22.077530 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7245ec0f-80fb-46e0-a1a3-6284c2c562cf tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057872 Sep 04 16:18:22.082738 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 306/608] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:18:22 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:18:22.347709 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-df6bf1d6-8f4f-4d5d-ba40-7687abf0f16c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:22.350112 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-df6bf1d6-8f4f-4d5d-ba40-7687abf0f16c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:22.356700 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-df6bf1d6-8f4f-4d5d-ba40-7687abf0f16c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:22.363910 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-df6bf1d6-8f4f-4d5d-ba40-7687abf0f16c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:22.363910 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-df6bf1d6-8f4f-4d5d-ba40-7687abf0f16c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:22.363910 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-df6bf1d6-8f4f-4d5d-ba40-7687abf0f16c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:22.363910 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-df6bf1d6-8f4f-4d5d-ba40-7687abf0f16c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:22.364305 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-df6bf1d6-8f4f-4d5d-ba40-7687abf0f16c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:22.389426 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:18:22.394849 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-df6bf1d6-8f4f-4d5d-ba40-7687abf0f16c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051297 Sep 04 16:18:22.395436 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 303/609] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Sep 4 16:18:22 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:18:23.092850 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fa90e4fb-44e4-4474-811e-12ed5c563fe4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:23.095004 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fa90e4fb-44e4-4474-811e-12ed5c563fe4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:23.104358 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa90e4fb-44e4-4474-811e-12ed5c563fe4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:23.104849 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa90e4fb-44e4-4474-811e-12ed5c563fe4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:23.105352 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa90e4fb-44e4-4474-811e-12ed5c563fe4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:23.106058 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa90e4fb-44e4-4474-811e-12ed5c563fe4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:23.106484 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa90e4fb-44e4-4474-811e-12ed5c563fe4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:23.106977 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa90e4fb-44e4-4474-811e-12ed5c563fe4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:23.142804 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fa90e4fb-44e4-4474-811e-12ed5c563fe4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056554 Sep 04 16:18:23.143284 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 307/610] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:18:23 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:18:23.407673 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-77faf8f6-fee9-4a41-8725-6e5b5c1b6ce2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:23.409851 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-77faf8f6-fee9-4a41-8725-6e5b5c1b6ce2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:23.416773 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-77faf8f6-fee9-4a41-8725-6e5b5c1b6ce2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:23.417356 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-77faf8f6-fee9-4a41-8725-6e5b5c1b6ce2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:23.417871 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-77faf8f6-fee9-4a41-8725-6e5b5c1b6ce2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:23.418761 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-77faf8f6-fee9-4a41-8725-6e5b5c1b6ce2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:23.419373 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-77faf8f6-fee9-4a41-8725-6e5b5c1b6ce2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:23.419787 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-77faf8f6-fee9-4a41-8725-6e5b5c1b6ce2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:23.453334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-77faf8f6-fee9-4a41-8725-6e5b5c1b6ce2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050103 Sep 04 16:18:23.453902 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 304/611] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Sep 4 16:18:23 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:18:24.155745 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9c5cc4bc-8c22-41b9-b759-419dbe403872 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:24.157934 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9c5cc4bc-8c22-41b9-b759-419dbe403872 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:24.165751 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c5cc4bc-8c22-41b9-b759-419dbe403872 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:24.166444 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c5cc4bc-8c22-41b9-b759-419dbe403872 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:24.167233 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c5cc4bc-8c22-41b9-b759-419dbe403872 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:24.168219 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c5cc4bc-8c22-41b9-b759-419dbe403872 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:24.168830 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c5cc4bc-8c22-41b9-b759-419dbe403872 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:24.169393 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9c5cc4bc-8c22-41b9-b759-419dbe403872 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:24.202374 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9c5cc4bc-8c22-41b9-b759-419dbe403872 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050479 Sep 04 16:18:24.203552 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 308/612] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:18:24 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:18:24.467895 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b5f8b4de-afc3-49b2-bf7d-1264f188ff97 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:24.470640 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b5f8b4de-afc3-49b2-bf7d-1264f188ff97 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:24.479266 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b5f8b4de-afc3-49b2-bf7d-1264f188ff97 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:24.488962 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b5f8b4de-afc3-49b2-bf7d-1264f188ff97 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:24.488962 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b5f8b4de-afc3-49b2-bf7d-1264f188ff97 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:24.488962 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b5f8b4de-afc3-49b2-bf7d-1264f188ff97 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:24.488962 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b5f8b4de-afc3-49b2-bf7d-1264f188ff97 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:24.489490 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b5f8b4de-afc3-49b2-bf7d-1264f188ff97 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:24.518952 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b5f8b4de-afc3-49b2-bf7d-1264f188ff97 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056242 Sep 04 16:18:24.524864 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 305/613] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Sep 4 16:18:24 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:18:25.215365 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f3a45239-3e8f-478b-915b-cd5de86827a8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:25.218351 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f3a45239-3e8f-478b-915b-cd5de86827a8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:25.224705 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3a45239-3e8f-478b-915b-cd5de86827a8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:25.225194 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3a45239-3e8f-478b-915b-cd5de86827a8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:25.225664 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3a45239-3e8f-478b-915b-cd5de86827a8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:25.226374 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3a45239-3e8f-478b-915b-cd5de86827a8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:25.226889 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3a45239-3e8f-478b-915b-cd5de86827a8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:25.227518 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3a45239-3e8f-478b-915b-cd5de86827a8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:25.262013 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f3a45239-3e8f-478b-915b-cd5de86827a8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050549 Sep 04 16:18:25.262564 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 309/614] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:18:25 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:18:25.532115 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-69b71b07-6032-43d4-87d1-37507fe3093d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:25.534260 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-69b71b07-6032-43d4-87d1-37507fe3093d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:25.541265 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69b71b07-6032-43d4-87d1-37507fe3093d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:25.546499 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69b71b07-6032-43d4-87d1-37507fe3093d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:25.546499 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69b71b07-6032-43d4-87d1-37507fe3093d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:25.546499 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69b71b07-6032-43d4-87d1-37507fe3093d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:25.546499 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69b71b07-6032-43d4-87d1-37507fe3093d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:25.546922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69b71b07-6032-43d4-87d1-37507fe3093d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:25.574048 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-69b71b07-6032-43d4-87d1-37507fe3093d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045804 Sep 04 16:18:25.574610 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 306/615] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Sep 4 16:18:25 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:18:26.277305 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aa626870-c0b5-4ef4-aacd-04d31c95921b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:26.281378 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aa626870-c0b5-4ef4-aacd-04d31c95921b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:26.294638 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa626870-c0b5-4ef4-aacd-04d31c95921b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:26.294638 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa626870-c0b5-4ef4-aacd-04d31c95921b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:26.294638 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa626870-c0b5-4ef4-aacd-04d31c95921b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:26.294638 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa626870-c0b5-4ef4-aacd-04d31c95921b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:26.295097 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa626870-c0b5-4ef4-aacd-04d31c95921b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:26.296051 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa626870-c0b5-4ef4-aacd-04d31c95921b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:26.335625 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aa626870-c0b5-4ef4-aacd-04d31c95921b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064376 Sep 04 16:18:26.337833 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 310/616] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:18:26 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:18:26.585911 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0af86653-c50d-43d1-ad6c-22b2c52f70fa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:26.588269 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0af86653-c50d-43d1-ad6c-22b2c52f70fa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:26.605813 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0af86653-c50d-43d1-ad6c-22b2c52f70fa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:26.606302 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0af86653-c50d-43d1-ad6c-22b2c52f70fa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:26.606989 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0af86653-c50d-43d1-ad6c-22b2c52f70fa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:26.608182 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0af86653-c50d-43d1-ad6c-22b2c52f70fa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:26.608629 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0af86653-c50d-43d1-ad6c-22b2c52f70fa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:26.609217 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0af86653-c50d-43d1-ad6c-22b2c52f70fa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:26.642652 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0af86653-c50d-43d1-ad6c-22b2c52f70fa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060638 Sep 04 16:18:26.643235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 307/617] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Sep 4 16:18:26 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 04 16:18:27.350094 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-821d7ce1-5a08-44c6-80f2-81c20ad41e07 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:27.359589 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-821d7ce1-5a08-44c6-80f2-81c20ad41e07 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:27.369920 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-821d7ce1-5a08-44c6-80f2-81c20ad41e07 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:27.370610 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-821d7ce1-5a08-44c6-80f2-81c20ad41e07 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:27.371310 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-821d7ce1-5a08-44c6-80f2-81c20ad41e07 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:27.372151 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-821d7ce1-5a08-44c6-80f2-81c20ad41e07 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:27.372666 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-821d7ce1-5a08-44c6-80f2-81c20ad41e07 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:27.374726 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-821d7ce1-5a08-44c6-80f2-81c20ad41e07 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:27.415827 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-821d7ce1-5a08-44c6-80f2-81c20ad41e07 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069836 Sep 04 16:18:27.416787 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 311/618] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:18:27 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:18:27.656101 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b8e1b465-d1fb-43be-9d82-f397ef55e536 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:27.658525 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b8e1b465-d1fb-43be-9d82-f397ef55e536 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:27.690982 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b8e1b465-d1fb-43be-9d82-f397ef55e536 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:27.691479 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b8e1b465-d1fb-43be-9d82-f397ef55e536 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:27.694500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b8e1b465-d1fb-43be-9d82-f397ef55e536 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:27.694500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b8e1b465-d1fb-43be-9d82-f397ef55e536 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:27.694500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b8e1b465-d1fb-43be-9d82-f397ef55e536 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:27.698918 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b8e1b465-d1fb-43be-9d82-f397ef55e536 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:27.736614 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b8e1b465-d1fb-43be-9d82-f397ef55e536 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084607 Sep 04 16:18:27.741747 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 308/619] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Sep 4 16:18:27 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:18:28.012969 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-15175145-c820-4ef1-853f-08d4ee04c8e0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:18:28.015580 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-15175145-c820-4ef1-853f-08d4ee04c8e0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:28.028937 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15175145-c820-4ef1-853f-08d4ee04c8e0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:28.029436 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15175145-c820-4ef1-853f-08d4ee04c8e0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:28.029894 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15175145-c820-4ef1-853f-08d4ee04c8e0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:28.032532 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15175145-c820-4ef1-853f-08d4ee04c8e0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:28.032532 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15175145-c820-4ef1-853f-08d4ee04c8e0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:28.032532 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-15175145-c820-4ef1-853f-08d4ee04c8e0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:28.059116 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-15175145-c820-4ef1-853f-08d4ee04c8e0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lazy-loading 'flavor' on Instance uuid 0188e4a8-e601-43da-b389-7e0a8410ae8d {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:18:28.433687 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1c85a0bf-88cf-4272-9b38-7d35b101298c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:28.447285 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1c85a0bf-88cf-4272-9b38-7d35b101298c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:28.460865 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1c85a0bf-88cf-4272-9b38-7d35b101298c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:28.463084 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1c85a0bf-88cf-4272-9b38-7d35b101298c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:28.463743 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1c85a0bf-88cf-4272-9b38-7d35b101298c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:28.464714 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1c85a0bf-88cf-4272-9b38-7d35b101298c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:28.465600 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1c85a0bf-88cf-4272-9b38-7d35b101298c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:28.466486 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1c85a0bf-88cf-4272-9b38-7d35b101298c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:28.508693 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1c85a0bf-88cf-4272-9b38-7d35b101298c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083557 Sep 04 16:18:28.510194 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 309/620] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:18:28 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:18:28.566444 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-15175145-c820-4ef1-853f-08d4ee04c8e0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "POST /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d/action" status: 200 len: 32 microversion: 2.1 time: 0.558953 Sep 04 16:18:28.568490 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 312/621] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Sep 4 16:18:28 2022] POST /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d/action => generated 32 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 04 16:18:28.580372 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6b3c3f5b-4287-487c-8ada-31836f7f189f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:28.580372 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6b3c3f5b-4287-487c-8ada-31836f7f189f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:28.594295 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6b3c3f5b-4287-487c-8ada-31836f7f189f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:28.594764 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6b3c3f5b-4287-487c-8ada-31836f7f189f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:28.595326 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6b3c3f5b-4287-487c-8ada-31836f7f189f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:28.597081 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6b3c3f5b-4287-487c-8ada-31836f7f189f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:28.598953 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6b3c3f5b-4287-487c-8ada-31836f7f189f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:28.601423 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6b3c3f5b-4287-487c-8ada-31836f7f189f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:28.750719 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-80fd5d8a-11ba-49d8-aac2-ac2aa6f9ed49 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:28.752988 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-80fd5d8a-11ba-49d8-aac2-ac2aa6f9ed49 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:28.766271 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80fd5d8a-11ba-49d8-aac2-ac2aa6f9ed49 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:28.767567 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80fd5d8a-11ba-49d8-aac2-ac2aa6f9ed49 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:28.768240 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80fd5d8a-11ba-49d8-aac2-ac2aa6f9ed49 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:28.770300 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80fd5d8a-11ba-49d8-aac2-ac2aa6f9ed49 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:28.774796 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80fd5d8a-11ba-49d8-aac2-ac2aa6f9ed49 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:28.774796 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-80fd5d8a-11ba-49d8-aac2-ac2aa6f9ed49 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:28.855085 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-80fd5d8a-11ba-49d8-aac2-ac2aa6f9ed49 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.108991 Sep 04 16:18:28.855985 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 313/622] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Sep 4 16:18:28 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:18:28.897101 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6b3c3f5b-4287-487c-8ada-31836f7f189f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:28.910240 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6b3c3f5b-4287-487c-8ada-31836f7f189f tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.334614 Sep 04 16:18:28.915608 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 310/623] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:28 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:29.522252 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bcce8e8f-527c-411a-a53c-c1f299746770 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:29.525158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bcce8e8f-527c-411a-a53c-c1f299746770 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:29.532235 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bcce8e8f-527c-411a-a53c-c1f299746770 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:29.532953 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bcce8e8f-527c-411a-a53c-c1f299746770 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:29.533582 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bcce8e8f-527c-411a-a53c-c1f299746770 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:29.534459 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bcce8e8f-527c-411a-a53c-c1f299746770 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:29.534914 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bcce8e8f-527c-411a-a53c-c1f299746770 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:29.541372 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bcce8e8f-527c-411a-a53c-c1f299746770 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:29.567187 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bcce8e8f-527c-411a-a53c-c1f299746770 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048901 Sep 04 16:18:29.567820 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 314/624] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:18:29 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 04 16:18:29.635439 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-335ae3a1-f0b5-4a5a-8ff7-fe70546311f8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:29.635928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-335ae3a1-f0b5-4a5a-8ff7-fe70546311f8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:29.642314 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-335ae3a1-f0b5-4a5a-8ff7-fe70546311f8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:29.642792 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-335ae3a1-f0b5-4a5a-8ff7-fe70546311f8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:29.643224 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-335ae3a1-f0b5-4a5a-8ff7-fe70546311f8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:29.643932 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-335ae3a1-f0b5-4a5a-8ff7-fe70546311f8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:29.644375 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-335ae3a1-f0b5-4a5a-8ff7-fe70546311f8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:29.644791 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-335ae3a1-f0b5-4a5a-8ff7-fe70546311f8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:29.671083 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-335ae3a1-f0b5-4a5a-8ff7-fe70546311f8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 16:18:29.874484 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-336fa3c2-6127-4525-a345-aaaa5964cd65 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:29.877549 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-336fa3c2-6127-4525-a345-aaaa5964cd65 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:29.897732 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-336fa3c2-6127-4525-a345-aaaa5964cd65 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:29.898548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-336fa3c2-6127-4525-a345-aaaa5964cd65 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:29.899931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-336fa3c2-6127-4525-a345-aaaa5964cd65 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:29.900939 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-336fa3c2-6127-4525-a345-aaaa5964cd65 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:29.901406 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-336fa3c2-6127-4525-a345-aaaa5964cd65 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:29.901857 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-336fa3c2-6127-4525-a345-aaaa5964cd65 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:29.931484 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-335ae3a1-f0b5-4a5a-8ff7-fe70546311f8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "DELETE /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 204 len: 0 microversion: 2.1 time: 0.299808 Sep 04 16:18:29.935531 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 311/625] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:18:29 2022] DELETE /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 16:18:29.941366 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fc82490f-e2a4-47a3-bba3-2b1fef2e8a72 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:29.942192 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fc82490f-e2a4-47a3-bba3-2b1fef2e8a72 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:29.942366 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-336fa3c2-6127-4525-a345-aaaa5964cd65 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.076752 Sep 04 16:18:29.950278 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 315/626] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Sep 4 16:18:29 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:29.950278 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fa929329-bdf4-4d2c-aa77-f8b12df00a8c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:29.950278 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fa929329-bdf4-4d2c-aa77-f8b12df00a8c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:29.958989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa929329-bdf4-4d2c-aa77-f8b12df00a8c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:29.959380 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc82490f-e2a4-47a3-bba3-2b1fef2e8a72 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:29.959935 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc82490f-e2a4-47a3-bba3-2b1fef2e8a72 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:29.960104 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa929329-bdf4-4d2c-aa77-f8b12df00a8c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:29.960372 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc82490f-e2a4-47a3-bba3-2b1fef2e8a72 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:29.960768 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa929329-bdf4-4d2c-aa77-f8b12df00a8c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:29.961081 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc82490f-e2a4-47a3-bba3-2b1fef2e8a72 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:29.961642 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc82490f-e2a4-47a3-bba3-2b1fef2e8a72 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:29.961815 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa929329-bdf4-4d2c-aa77-f8b12df00a8c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:29.962054 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc82490f-e2a4-47a3-bba3-2b1fef2e8a72 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:29.962219 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa929329-bdf4-4d2c-aa77-f8b12df00a8c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:29.962892 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa929329-bdf4-4d2c-aa77-f8b12df00a8c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:30.206925 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fc82490f-e2a4-47a3-bba3-2b1fef2e8a72 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:30.221332 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-fa929329-bdf4-4d2c-aa77-f8b12df00a8c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:30.224613 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fc82490f-e2a4-47a3-bba3-2b1fef2e8a72 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1683 microversion: 2.1 time: 0.287694 Sep 04 16:18:30.225203 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 312/627] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:29 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1683 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:18:30.238183 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1f951c90-154a-4f39-b4a3-5033a7215f92 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:30.238183 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1f951c90-154a-4f39-b4a3-5033a7215f92 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:30.246136 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fa929329-bdf4-4d2c-aa77-f8b12df00a8c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.301672 Sep 04 16:18:30.246915 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 316/628] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:29 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:30.254265 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1f951c90-154a-4f39-b4a3-5033a7215f92 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:30.254265 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1f951c90-154a-4f39-b4a3-5033a7215f92 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:30.254265 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1f951c90-154a-4f39-b4a3-5033a7215f92 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:30.255465 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1f951c90-154a-4f39-b4a3-5033a7215f92 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:30.258745 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1f951c90-154a-4f39-b4a3-5033a7215f92 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:30.259413 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1f951c90-154a-4f39-b4a3-5033a7215f92 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:30.296020 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1f951c90-154a-4f39-b4a3-5033a7215f92 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 16:18:30.507232 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:18:30.577052 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1f951c90-154a-4f39-b4a3-5033a7215f92 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "DELETE /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 204 len: 0 microversion: 2.20 time: 0.347983 Sep 04 16:18:30.577838 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 313/629] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Sep 4 16:18:30 2022] DELETE /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 04 16:18:30.587479 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fa7e6870-4c73-4999-b170-2016fb8503cc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:30.588340 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fa7e6870-4c73-4999-b170-2016fb8503cc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:30.596111 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:18:30.603623 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa7e6870-4c73-4999-b170-2016fb8503cc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:30.604319 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa7e6870-4c73-4999-b170-2016fb8503cc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:30.604945 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa7e6870-4c73-4999-b170-2016fb8503cc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:30.605866 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa7e6870-4c73-4999-b170-2016fb8503cc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:30.606428 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa7e6870-4c73-4999-b170-2016fb8503cc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:30.607268 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa7e6870-4c73-4999-b170-2016fb8503cc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:30.772973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-fa7e6870-4c73-4999-b170-2016fb8503cc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:30.782280 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-fa7e6870-4c73-4999-b170-2016fb8503cc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:30.783839 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-fa7e6870-4c73-4999-b170-2016fb8503cc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:30.785088 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fa7e6870-4c73-4999-b170-2016fb8503cc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1723 microversion: 2.20 time: 0.202653 Sep 04 16:18:30.797020 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 317/630] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:18:30 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:18:31.253310 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d85377de-0b47-4f63-bc79-3d71ae906147 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:31.254951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d85377de-0b47-4f63-bc79-3d71ae906147 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:31.264540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d85377de-0b47-4f63-bc79-3d71ae906147 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:31.267078 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d85377de-0b47-4f63-bc79-3d71ae906147 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:31.267078 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d85377de-0b47-4f63-bc79-3d71ae906147 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:31.267078 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d85377de-0b47-4f63-bc79-3d71ae906147 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:31.267946 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d85377de-0b47-4f63-bc79-3d71ae906147 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:31.268377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d85377de-0b47-4f63-bc79-3d71ae906147 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:31.273233 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-933dcdfa-3206-4090-8493-eacbc2c4ff36 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:31.278608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-933dcdfa-3206-4090-8493-eacbc2c4ff36 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:31.284349 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-933dcdfa-3206-4090-8493-eacbc2c4ff36 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:31.285790 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-933dcdfa-3206-4090-8493-eacbc2c4ff36 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:31.286331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-933dcdfa-3206-4090-8493-eacbc2c4ff36 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:31.287122 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-933dcdfa-3206-4090-8493-eacbc2c4ff36 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:31.288385 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-933dcdfa-3206-4090-8493-eacbc2c4ff36 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:31.289084 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-933dcdfa-3206-4090-8493-eacbc2c4ff36 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:31.501818 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d85377de-0b47-4f63-bc79-3d71ae906147 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:31.507352 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-933dcdfa-3206-4090-8493-eacbc2c4ff36 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:31.514003 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d85377de-0b47-4f63-bc79-3d71ae906147 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1683 microversion: 2.1 time: 0.265807 Sep 04 16:18:31.516370 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 314/631] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:31 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1683 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:31.518331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-933dcdfa-3206-4090-8493-eacbc2c4ff36 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.249581 Sep 04 16:18:31.519181 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 318/632] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:31 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:18:31.812009 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5e626546-f2a4-4f7e-81eb-cba61ec19367 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:31.813984 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5e626546-f2a4-4f7e-81eb-cba61ec19367 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:31.823830 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5e626546-f2a4-4f7e-81eb-cba61ec19367 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:31.824337 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5e626546-f2a4-4f7e-81eb-cba61ec19367 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:31.824772 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5e626546-f2a4-4f7e-81eb-cba61ec19367 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:31.825724 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5e626546-f2a4-4f7e-81eb-cba61ec19367 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:31.826178 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5e626546-f2a4-4f7e-81eb-cba61ec19367 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:31.826601 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5e626546-f2a4-4f7e-81eb-cba61ec19367 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:31.989740 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5e626546-f2a4-4f7e-81eb-cba61ec19367 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:32.000472 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5e626546-f2a4-4f7e-81eb-cba61ec19367 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:32.002427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5e626546-f2a4-4f7e-81eb-cba61ec19367 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:32.004263 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5e626546-f2a4-4f7e-81eb-cba61ec19367 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1723 microversion: 2.20 time: 0.196168 Sep 04 16:18:32.006958 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 315/633] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:18:31 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:18:32.543844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9dea6e9e-3088-4e94-9199-f153c8a72373 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:32.547659 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9dea6e9e-3088-4e94-9199-f153c8a72373 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:32.552512 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9dea6e9e-3088-4e94-9199-f153c8a72373 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:32.553002 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9dea6e9e-3088-4e94-9199-f153c8a72373 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:32.553433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9dea6e9e-3088-4e94-9199-f153c8a72373 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:32.554172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9dea6e9e-3088-4e94-9199-f153c8a72373 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:32.554623 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9dea6e9e-3088-4e94-9199-f153c8a72373 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:32.555087 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9dea6e9e-3088-4e94-9199-f153c8a72373 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:32.557161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e1dd8f27-dbda-42c4-9408-921e99cac5be tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:32.557849 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e1dd8f27-dbda-42c4-9408-921e99cac5be tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:32.565392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e1dd8f27-dbda-42c4-9408-921e99cac5be tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:32.566045 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e1dd8f27-dbda-42c4-9408-921e99cac5be tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:32.566585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e1dd8f27-dbda-42c4-9408-921e99cac5be tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:32.567400 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e1dd8f27-dbda-42c4-9408-921e99cac5be tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:32.567855 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e1dd8f27-dbda-42c4-9408-921e99cac5be tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:32.568336 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e1dd8f27-dbda-42c4-9408-921e99cac5be tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:32.750780 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-9dea6e9e-3088-4e94-9199-f153c8a72373 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:32.760395 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9dea6e9e-3088-4e94-9199-f153c8a72373 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1683 microversion: 2.1 time: 0.221033 Sep 04 16:18:32.761352 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 319/634] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:32 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1683 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:32.769740 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e1dd8f27-dbda-42c4-9408-921e99cac5be tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:32.778558 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e1dd8f27-dbda-42c4-9408-921e99cac5be tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.225452 Sep 04 16:18:32.779136 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 316/635] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:32 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:33.045446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b61ec6ae-5e67-4534-9daa-24970182ec88 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:33.046207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b61ec6ae-5e67-4534-9daa-24970182ec88 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:33.054177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b61ec6ae-5e67-4534-9daa-24970182ec88 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:33.055709 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b61ec6ae-5e67-4534-9daa-24970182ec88 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:33.057296 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b61ec6ae-5e67-4534-9daa-24970182ec88 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:33.058287 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b61ec6ae-5e67-4534-9daa-24970182ec88 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:33.058969 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b61ec6ae-5e67-4534-9daa-24970182ec88 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:33.059606 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b61ec6ae-5e67-4534-9daa-24970182ec88 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:33.491186 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b61ec6ae-5e67-4534-9daa-24970182ec88 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:33.508466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b61ec6ae-5e67-4534-9daa-24970182ec88 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:33.513344 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b61ec6ae-5e67-4534-9daa-24970182ec88 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:33.515124 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b61ec6ae-5e67-4534-9daa-24970182ec88 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1723 microversion: 2.20 time: 0.482517 Sep 04 16:18:33.516189 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 320/636] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:18:33 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1723 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:18:33.784405 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c7ec6945-056f-492d-ad41-19c58da6c230 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:33.786359 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c7ec6945-056f-492d-ad41-19c58da6c230 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:33.800673 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c7ec6945-056f-492d-ad41-19c58da6c230 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:33.801539 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c7ec6945-056f-492d-ad41-19c58da6c230 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:33.803149 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-031d43b7-5952-4b69-8549-3741af38e993 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:33.803815 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-031d43b7-5952-4b69-8549-3741af38e993 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:33.804182 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c7ec6945-056f-492d-ad41-19c58da6c230 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:33.807172 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c7ec6945-056f-492d-ad41-19c58da6c230 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:33.807923 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c7ec6945-056f-492d-ad41-19c58da6c230 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:33.810206 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c7ec6945-056f-492d-ad41-19c58da6c230 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:33.815364 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-031d43b7-5952-4b69-8549-3741af38e993 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:33.821348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-031d43b7-5952-4b69-8549-3741af38e993 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:33.825905 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-031d43b7-5952-4b69-8549-3741af38e993 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:33.826986 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-031d43b7-5952-4b69-8549-3741af38e993 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:33.827617 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-031d43b7-5952-4b69-8549-3741af38e993 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:33.828595 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-031d43b7-5952-4b69-8549-3741af38e993 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:33.850854 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:18:33.870718 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:18:34.586402 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-031d43b7-5952-4b69-8549-3741af38e993 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:34.601845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-031d43b7-5952-4b69-8549-3741af38e993 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.803048 Sep 04 16:18:34.603740 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 321/637] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:33 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:18:34.608606 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f3247b2a-5e64-464b-928e-a2c912f02aef tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:34.622746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f3247b2a-5e64-464b-928e-a2c912f02aef tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:34.628703 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3247b2a-5e64-464b-928e-a2c912f02aef tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:34.629194 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3247b2a-5e64-464b-928e-a2c912f02aef tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:34.629659 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3247b2a-5e64-464b-928e-a2c912f02aef tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:34.630368 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3247b2a-5e64-464b-928e-a2c912f02aef tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:34.630826 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3247b2a-5e64-464b-928e-a2c912f02aef tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:34.631295 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f3247b2a-5e64-464b-928e-a2c912f02aef tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:34.655452 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c7ec6945-056f-492d-ad41-19c58da6c230 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:34.667766 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c7ec6945-056f-492d-ad41-19c58da6c230 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1683 microversion: 2.1 time: 0.887308 Sep 04 16:18:34.683528 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 317/638] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:33 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1683 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:35.405910 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f3247b2a-5e64-464b-928e-a2c912f02aef tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:35.429148 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f3247b2a-5e64-464b-928e-a2c912f02aef tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:35.431301 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f3247b2a-5e64-464b-928e-a2c912f02aef tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:35.434762 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f3247b2a-5e64-464b-928e-a2c912f02aef tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1723 microversion: 2.20 time: 0.829824 Sep 04 16:18:35.438984 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 322/639] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:18:34 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1723 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:18:35.637647 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-45bc8b90-76e4-4ed0-9c43-5f0851400d04 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:35.638402 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-45bc8b90-76e4-4ed0-9c43-5f0851400d04 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:35.651395 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45bc8b90-76e4-4ed0-9c43-5f0851400d04 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:35.652149 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45bc8b90-76e4-4ed0-9c43-5f0851400d04 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:35.654688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45bc8b90-76e4-4ed0-9c43-5f0851400d04 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:35.655656 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45bc8b90-76e4-4ed0-9c43-5f0851400d04 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:35.656128 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45bc8b90-76e4-4ed0-9c43-5f0851400d04 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:35.656562 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45bc8b90-76e4-4ed0-9c43-5f0851400d04 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:35.699462 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4d8e3052-ae58-47a8-aaf8-487a54ba0310 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:35.700519 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4d8e3052-ae58-47a8-aaf8-487a54ba0310 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:35.716597 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d8e3052-ae58-47a8-aaf8-487a54ba0310 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:35.719455 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d8e3052-ae58-47a8-aaf8-487a54ba0310 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:35.720205 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d8e3052-ae58-47a8-aaf8-487a54ba0310 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:35.721420 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d8e3052-ae58-47a8-aaf8-487a54ba0310 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:35.722264 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d8e3052-ae58-47a8-aaf8-487a54ba0310 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:35.722912 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d8e3052-ae58-47a8-aaf8-487a54ba0310 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:35.891388 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4d8e3052-ae58-47a8-aaf8-487a54ba0310 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:35.905611 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4d8e3052-ae58-47a8-aaf8-487a54ba0310 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1616 microversion: 2.1 time: 0.212562 Sep 04 16:18:35.910334 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 323/640] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:35 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1616 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:35.918895 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-5dd36019-f23d-484f-9ce0-7266f7a0193b req-db54eb84-988f-4b50-80a8-cc72358abef4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449c2258-280e-405f-a3d1-498688a52529", "name": "network-vif-deleted", "tag": "34cf8243-0fd0-4c2f-b7aa-78222c3a9a6a"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:18:35.940851 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5dd36019-f23d-484f-9ce0-7266f7a0193b req-db54eb84-988f-4b50-80a8-cc72358abef4 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:35.942442 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5dd36019-f23d-484f-9ce0-7266f7a0193b req-db54eb84-988f-4b50-80a8-cc72358abef4 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:35.943144 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-5dd36019-f23d-484f-9ce0-7266f7a0193b req-db54eb84-988f-4b50-80a8-cc72358abef4 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:36.011456 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-5dd36019-f23d-484f-9ce0-7266f7a0193b req-db54eb84-988f-4b50-80a8-cc72358abef4 service nova] Creating event network-vif-deleted:34cf8243-0fd0-4c2f-b7aa-78222c3a9a6a for instance 449c2258-280e-405f-a3d1-498688a52529 on hv-cinder-85236 Sep 04 16:18:36.023566 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-5dd36019-f23d-484f-9ce0-7266f7a0193b req-db54eb84-988f-4b50-80a8-cc72358abef4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110456 Sep 04 16:18:36.027179 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 324/641] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:18:36.076252 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-45bc8b90-76e4-4ed0-9c43-5f0851400d04 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:36.089181 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-45bc8b90-76e4-4ed0-9c43-5f0851400d04 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.462953 Sep 04 16:18:36.089791 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 318/642] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:35 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:36.473098 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f29d6f25-d3c1-4cef-adea-05b812755cbd tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:36.479556 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f29d6f25-d3c1-4cef-adea-05b812755cbd tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:36.503194 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29d6f25-d3c1-4cef-adea-05b812755cbd tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:36.506660 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29d6f25-d3c1-4cef-adea-05b812755cbd tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:36.508032 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29d6f25-d3c1-4cef-adea-05b812755cbd tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:36.510127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29d6f25-d3c1-4cef-adea-05b812755cbd tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:36.513823 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29d6f25-d3c1-4cef-adea-05b812755cbd tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:36.514447 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29d6f25-d3c1-4cef-adea-05b812755cbd tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:36.597038 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29d6f25-d3c1-4cef-adea-05b812755cbd tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:36.597886 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29d6f25-d3c1-4cef-adea-05b812755cbd tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:36.598485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29d6f25-d3c1-4cef-adea-05b812755cbd tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:36.599090 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-f29d6f25-d3c1-4cef-adea-05b812755cbd tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lazy-loading 'fault' on Instance uuid 25192300-f22a-4b50-b390-17236f961eb5 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:18:36.683919 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f29d6f25-d3c1-4cef-adea-05b812755cbd tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:36.699013 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f29d6f25-d3c1-4cef-adea-05b812755cbd tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:36.706913 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f29d6f25-d3c1-4cef-adea-05b812755cbd tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:36.712476 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f29d6f25-d3c1-4cef-adea-05b812755cbd tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1371 microversion: 2.20 time: 0.244246 Sep 04 16:18:36.715096 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 325/643] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:18:36 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1371 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:18:36.940268 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6cf7c8a9-f461-4e70-bfb2-260f0e480710 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:36.944028 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6cf7c8a9-f461-4e70-bfb2-260f0e480710 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:36.960093 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6cf7c8a9-f461-4e70-bfb2-260f0e480710 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:36.963764 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6cf7c8a9-f461-4e70-bfb2-260f0e480710 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:36.965498 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6cf7c8a9-f461-4e70-bfb2-260f0e480710 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:36.966418 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6cf7c8a9-f461-4e70-bfb2-260f0e480710 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:36.967055 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6cf7c8a9-f461-4e70-bfb2-260f0e480710 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:36.967649 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6cf7c8a9-f461-4e70-bfb2-260f0e480710 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:37.035890 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6cf7c8a9-f461-4e70-bfb2-260f0e480710 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:37.036385 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6cf7c8a9-f461-4e70-bfb2-260f0e480710 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:37.036822 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6cf7c8a9-f461-4e70-bfb2-260f0e480710 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:37.037275 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-6cf7c8a9-f461-4e70-bfb2-260f0e480710 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lazy-loading 'fault' on Instance uuid 449c2258-280e-405f-a3d1-498688a52529 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:18:37.116497 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1511407a-9aa0-4c1b-b2cd-1ae4a0cc11b8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:37.117358 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1511407a-9aa0-4c1b-b2cd-1ae4a0cc11b8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:37.126438 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6cf7c8a9-f461-4e70-bfb2-260f0e480710 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:37.133440 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1511407a-9aa0-4c1b-b2cd-1ae4a0cc11b8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:37.134437 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1511407a-9aa0-4c1b-b2cd-1ae4a0cc11b8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:37.135012 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1511407a-9aa0-4c1b-b2cd-1ae4a0cc11b8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:37.135854 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1511407a-9aa0-4c1b-b2cd-1ae4a0cc11b8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:37.137652 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6cf7c8a9-f461-4e70-bfb2-260f0e480710 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 200 len: 1332 microversion: 2.1 time: 0.209136 Sep 04 16:18:37.138269 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1511407a-9aa0-4c1b-b2cd-1ae4a0cc11b8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:37.138947 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 319/644] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:36 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 1332 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:37.139084 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1511407a-9aa0-4c1b-b2cd-1ae4a0cc11b8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:37.392324 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1511407a-9aa0-4c1b-b2cd-1ae4a0cc11b8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:37.406775 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1511407a-9aa0-4c1b-b2cd-1ae4a0cc11b8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.294236 Sep 04 16:18:37.422160 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 326/645] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:37 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:37.754351 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8470f390-a1c5-423c-ad55-b361c61e4135 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:37.755357 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8470f390-a1c5-423c-ad55-b361c61e4135 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:37.764207 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8470f390-a1c5-423c-ad55-b361c61e4135 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:37.764944 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8470f390-a1c5-423c-ad55-b361c61e4135 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:37.765623 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8470f390-a1c5-423c-ad55-b361c61e4135 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:37.766689 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8470f390-a1c5-423c-ad55-b361c61e4135 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:37.767655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8470f390-a1c5-423c-ad55-b361c61e4135 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:37.768311 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8470f390-a1c5-423c-ad55-b361c61e4135 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:37.834218 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8470f390-a1c5-423c-ad55-b361c61e4135 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:37.834727 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8470f390-a1c5-423c-ad55-b361c61e4135 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:37.835244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8470f390-a1c5-423c-ad55-b361c61e4135 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:37.835715 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-8470f390-a1c5-423c-ad55-b361c61e4135 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lazy-loading 'fault' on Instance uuid 25192300-f22a-4b50-b390-17236f961eb5 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:18:37.951649 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8470f390-a1c5-423c-ad55-b361c61e4135 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:37.961212 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8470f390-a1c5-423c-ad55-b361c61e4135 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:37.963140 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8470f390-a1c5-423c-ad55-b361c61e4135 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:37.964291 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8470f390-a1c5-423c-ad55-b361c61e4135 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 200 len: 1371 microversion: 2.20 time: 0.216340 Sep 04 16:18:37.964970 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 320/646] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:18:37 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:18:38.050634 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-bccf2a80-51b7-47ca-b49d-789028bd28e0 req-0a0794be-955a-4413-8863-b0d9676e3ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25192300-f22a-4b50-b390-17236f961eb5", "name": "network-vif-deleted", "tag": "ea45359b-6df0-4bcb-9182-26e4cca9bdd6"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:18:38.060410 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-bccf2a80-51b7-47ca-b49d-789028bd28e0 req-0a0794be-955a-4413-8863-b0d9676e3ca3 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:38.060879 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-bccf2a80-51b7-47ca-b49d-789028bd28e0 req-0a0794be-955a-4413-8863-b0d9676e3ca3 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:38.061338 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-bccf2a80-51b7-47ca-b49d-789028bd28e0 req-0a0794be-955a-4413-8863-b0d9676e3ca3 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:38.072679 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-bccf2a80-51b7-47ca-b49d-789028bd28e0 req-0a0794be-955a-4413-8863-b0d9676e3ca3 service nova] Creating event network-vif-deleted:ea45359b-6df0-4bcb-9182-26e4cca9bdd6 for instance 25192300-f22a-4b50-b390-17236f961eb5 on hv-cinder-85236 Sep 04 16:18:38.077663 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-bccf2a80-51b7-47ca-b49d-789028bd28e0 req-0a0794be-955a-4413-8863-b0d9676e3ca3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032476 Sep 04 16:18:38.078368 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 327/647] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:18:38.167031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-191eb6d0-9a2b-489d-8ebf-631712f0736c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:38.167642 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-191eb6d0-9a2b-489d-8ebf-631712f0736c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:38.174842 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-191eb6d0-9a2b-489d-8ebf-631712f0736c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:38.175397 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-191eb6d0-9a2b-489d-8ebf-631712f0736c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:38.175834 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-191eb6d0-9a2b-489d-8ebf-631712f0736c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:38.180709 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-191eb6d0-9a2b-489d-8ebf-631712f0736c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:38.181290 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-191eb6d0-9a2b-489d-8ebf-631712f0736c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:38.181791 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-191eb6d0-9a2b-489d-8ebf-631712f0736c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:38.197687 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-191eb6d0-9a2b-489d-8ebf-631712f0736c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] HTTP exception thrown: Instance 449c2258-280e-405f-a3d1-498688a52529 could not be found. Sep 04 16:18:38.199346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-191eb6d0-9a2b-489d-8ebf-631712f0736c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Request method failure captured: Sep 04 16:18:38.199346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 HTTP/1.1 Sep 04 16:18:38.199346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:18:38.199346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:18:38.199346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:18:38.199346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:18:38.199346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:18:38.199346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:18:38.199346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:18:38.199346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:18:38.199346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFM7CEjNpb-xR3hPJMPQ-wsTXSagT7BYEktfOgtljHhzvAeE20V1mpt42r1aF9sMAbjmPPVeaP94mwlrfyovEVPw6ArC_YpgCrCSBFtvcpj7IAtQcwG53eIdKr17VLDw7eStXYQicK9SnKgixnRa-ofn7JvVLgTmHvsJ-_KcGiq48xm4 Sep 04 16:18:38.199346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:18:38.199346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:18:38.199346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:18:38.199346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:18:38.199346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:18:38.199346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:18:38.199346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:18:38.199346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:18:38.199346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:18:38.199346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:18:38.204555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1cc5ea4158344d5c8a35bc5783410620", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}] Sep 04 16:18:38.204555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:18:38.204555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:18:38.204555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:18:38.204555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:18:38.204555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:18:38.204555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:18:38.204555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: 6e5c22b631df4600b9f920120b67fc67 Sep 04 16:18:38.204555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:18:38.204555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: > Sep 04 16:18:38.204555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Instance 449c2258-280e-405f-a3d1-498688a52529 could not be found. Sep 04 16:18:38.204555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': '449c2258-280e-405f-a3d1-498688a52529'} Sep 04 16:18:38.205441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:18:38.205441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:18:38.205441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:18:38.205441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:18:38.205441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:18:38.205441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:18:38.205441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:18:38.205441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:18:38.205441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:18:38.205441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:18:38.205441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 449c2258-280e-405f-a3d1-498688a52529 could not be found. Sep 04 16:18:38.205441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:18:38.205441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:18:38.205441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:18:38.205441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:18:38.205441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:18:38.205441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:18:38.205441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:18:38.205441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:18:38.205441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:18:38.206810 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:18:38.206810 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:18:38.206810 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:18:38.206810 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:18:38.206810 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:18:38.206810 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:18:38.206810 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:18:38.206810 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 449c2258-280e-405f-a3d1-498688a52529 could not be found. Sep 04 16:18:38.206810 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:18:38.206810 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:18:38.206810 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:18:38.206810 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:18:38.206810 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:18:38.206810 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:18:38.206810 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:18:38.206810 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:18:38.206810 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 449c2258-280e-405f-a3d1-498688a52529 could not be found. Sep 04 16:18:38.206810 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:18:38.208190 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-191eb6d0-9a2b-489d-8ebf-631712f0736c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Returning 404 to user: Instance 449c2258-280e-405f-a3d1-498688a52529 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:18:38.208190 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-191eb6d0-9a2b-489d-8ebf-631712f0736c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 404 len: 111 microversion: 2.1 time: 0.039235 Sep 04 16:18:38.208190 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 321/648] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:38 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:18:38.215184 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fa04cd38-da81-4d09-94f9-720fd9a5ab65 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '.version_select at 0x7f96891bd040>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:38.327039 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fa04cd38-da81-4d09-94f9-720fd9a5ab65 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1507779781" status: 202 len: 0 microversion: 2.1 time: 0.118283 Sep 04 16:18:38.331726 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 328/649] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Sep 4 16:18:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1507779781 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:18:38.431229 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-89282494-7921-48d8-88f3-61431844a7ba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:38.432630 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-89282494-7921-48d8-88f3-61431844a7ba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:38.438802 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89282494-7921-48d8-88f3-61431844a7ba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:38.439542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89282494-7921-48d8-88f3-61431844a7ba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:38.442196 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89282494-7921-48d8-88f3-61431844a7ba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:38.443074 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89282494-7921-48d8-88f3-61431844a7ba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:38.443638 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89282494-7921-48d8-88f3-61431844a7ba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:38.444161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-89282494-7921-48d8-88f3-61431844a7ba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:38.643151 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-89282494-7921-48d8-88f3-61431844a7ba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:38.655534 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-89282494-7921-48d8-88f3-61431844a7ba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.227396 Sep 04 16:18:38.657974 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 322/650] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:38 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:38.996490 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a056c434-5a88-4c9e-ab1e-d9256a861610 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:38.997697 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a056c434-5a88-4c9e-ab1e-d9256a861610 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:39.011856 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a056c434-5a88-4c9e-ab1e-d9256a861610 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:39.012454 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a056c434-5a88-4c9e-ab1e-d9256a861610 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:39.012963 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a056c434-5a88-4c9e-ab1e-d9256a861610 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:39.013804 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a056c434-5a88-4c9e-ab1e-d9256a861610 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:39.014330 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a056c434-5a88-4c9e-ab1e-d9256a861610 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:39.014826 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a056c434-5a88-4c9e-ab1e-d9256a861610 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:39.036948 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-a056c434-5a88-4c9e-ab1e-d9256a861610 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] HTTP exception thrown: Instance 25192300-f22a-4b50-b390-17236f961eb5 could not be found. Sep 04 16:18:39.038755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a056c434-5a88-4c9e-ab1e-d9256a861610 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Request method failure captured: Sep 04 16:18:39.038755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 HTTP/1.1 Sep 04 16:18:39.038755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:18:39.038755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:18:39.038755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:18:39.038755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 04 16:18:39.038755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:18:39.038755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:18:39.038755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:18:39.038755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:18:39.038755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFM66LdGBrKyEum4ImUpWqHnqyUTcOx-vYn5pH9Y6tWuUdEMtMHv_I1VFXcYlu9ggjltB-RbCpbzQMSJocPpbFiPZrd4_bOcYduI4ERdpxKwKkyGxzdKLmffAh5gijW50OZlJxNLfn2JQADs0eoXShr3D6U9xPmGe0Esx4KTSy4mZjXA Sep 04 16:18:39.038755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:18:39.038755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:18:39.038755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:18:39.038755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:18:39.038755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Openstack-Nova-Api-Version: 2.20 Sep 04 16:18:39.038755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:18:39.038755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:18:39.038755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: 3219dc7400ec4957a31b1b0fabfd8c56 Sep 04 16:18:39.038755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-243620880 Sep 04 16:18:39.038755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:18:39.038755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:18:39.042374 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3219dc7400ec4957a31b1b0fabfd8c56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3219dc7400ec4957a31b1b0fabfd8c56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3219dc7400ec4957a31b1b0fabfd8c56", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3219dc7400ec4957a31b1b0fabfd8c56"}]}] Sep 04 16:18:39.042374 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeShelveTestJSON-243620880 Sep 04 16:18:39.042374 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: 3219dc7400ec4957a31b1b0fabfd8c56 Sep 04 16:18:39.042374 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-243620880 Sep 04 16:18:39.042374 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-AttachVolumeShelveTestJSON-243620880-project Sep 04 16:18:39.042374 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:18:39.042374 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:18:39.042374 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: 1623e93ad6844cacae7cc1a71b339f22 Sep 04 16:18:39.042374 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeShelveTestJSON-243620880-project Sep 04 16:18:39.042374 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: > Sep 04 16:18:39.042374 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Instance 25192300-f22a-4b50-b390-17236f961eb5 could not be found. Sep 04 16:18:39.042374 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'id': '25192300-f22a-4b50-b390-17236f961eb5'} Sep 04 16:18:39.043147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:18:39.043147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:18:39.043147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:18:39.043147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:18:39.043147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:18:39.043147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:18:39.043147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:18:39.043147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:18:39.043147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:18:39.043147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:18:39.043147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25192300-f22a-4b50-b390-17236f961eb5 could not be found. Sep 04 16:18:39.043147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:18:39.043147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:18:39.043147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:18:39.043147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:18:39.043147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:18:39.043147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:18:39.043147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:18:39.043147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:18:39.043147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:18:39.044336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:18:39.044336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:18:39.044336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:18:39.044336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:18:39.044336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:18:39.044336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:18:39.044336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:18:39.044336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25192300-f22a-4b50-b390-17236f961eb5 could not be found. Sep 04 16:18:39.044336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:18:39.044336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:18:39.044336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:18:39.044336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:18:39.044336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:18:39.044336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:18:39.044336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:18:39.044336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:18:39.044336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25192300-f22a-4b50-b390-17236f961eb5 could not be found. Sep 04 16:18:39.044336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:18:39.046949 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a056c434-5a88-4c9e-ab1e-d9256a861610 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Returning 404 to user: Instance 25192300-f22a-4b50-b390-17236f961eb5 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:18:39.046949 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a056c434-5a88-4c9e-ab1e-d9256a861610 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 404 len: 111 microversion: 2.20 time: 0.056980 Sep 04 16:18:39.046949 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 329/651] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:18:38 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 04 16:18:39.052110 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8de88fea-0c97-4aee-9255-70567f9fbe38 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '.version_select at 0x7f96892be0d0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:39.181346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8de88fea-0c97-4aee-9255-70567f9fbe38 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200794846" status: 204 len: 0 microversion: 2.20 time: 0.131231 Sep 04 16:18:39.182228 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 323/652] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Sep 4 16:18:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1200794846 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 04 16:18:39.406581 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9581249e-4f06-48b2-8071-b5a72dc7c94a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Action: 'create', calling method: .version_select at 0x7f968920c820>, body: {"keypair": {"name": "tempest-keypair-229059128", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3c+Hzk4tdHw44fdvE0F6yNJfXs2sVRTe6UNHfeFKwxCYI5ji5E1D6ECICJA7o3X0pRhwypcyCHn1a85nrHTSeGbBz5E1TE66TniEE227/1PgXvah51C5I7urBRoZfMbQ=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:18:39.435130 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-9581249e-4f06-48b2-8071-b5a72dc7c94a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Getting quotas for project 1cc5ea4158344d5c8a35bc5783410620. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:18:39.440439 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-9581249e-4f06-48b2-8071-b5a72dc7c94a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Getting quotas for user 6e5c22b631df4600b9f920120b67fc67 and project 1cc5ea4158344d5c8a35bc5783410620. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:18:39.556060 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9581249e-4f06-48b2-8071-b5a72dc7c94a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.152555 Sep 04 16:18:39.557024 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 330/653] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Sep 4 16:18:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:18:39.684353 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f4413a34-3990-457d-9093-9492dacab2e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:39.684600 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f4413a34-3990-457d-9093-9492dacab2e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:39.692270 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f4413a34-3990-457d-9093-9492dacab2e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:39.692832 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f4413a34-3990-457d-9093-9492dacab2e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:39.693493 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f4413a34-3990-457d-9093-9492dacab2e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:39.694647 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f4413a34-3990-457d-9093-9492dacab2e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:39.695236 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f4413a34-3990-457d-9093-9492dacab2e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:39.695668 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f4413a34-3990-457d-9093-9492dacab2e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:39.878365 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f4413a34-3990-457d-9093-9492dacab2e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:39.888508 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f4413a34-3990-457d-9093-9492dacab2e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.212592 Sep 04 16:18:39.893652 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 324/654] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:39 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:18:40.226442 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6b3950f9-d3be-4819-bca5-d19fa9e07d5a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Action: 'create', calling method: .version_select at 0x7f968920ce50>, body: {"keypair": {"name": "tempest-keypair-1423648917", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyYUS/YmMyUwkO47FD/9MIIhqUaS56ksgco6XNf+54ebLt8J3Y9/ePC14XE7nvcVrMZEVnjUG22rqwR7JEWuvz46Voe7+CEJebS98pylPTg/uAZjwRpZIpN2vl1hku+0Q=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:18:40.245819 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-6b3950f9-d3be-4819-bca5-d19fa9e07d5a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Getting quotas for project 3219dc7400ec4957a31b1b0fabfd8c56. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:18:40.249844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-6b3950f9-d3be-4819-bca5-d19fa9e07d5a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Getting quotas for user 1623e93ad6844cacae7cc1a71b339f22 and project 3219dc7400ec4957a31b1b0fabfd8c56. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:18:40.355934 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6b3950f9-d3be-4819-bca5-d19fa9e07d5a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.134382 Sep 04 16:18:40.356880 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 331/655] 10.222.0.39 () {62 vars in 1200 bytes} [Sun Sep 4 16:18:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 136 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 04 16:18:40.912224 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-228e7415-3fc7-4a33-b089-98b588e7b06c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:40.912839 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-228e7415-3fc7-4a33-b089-98b588e7b06c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:40.919641 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-228e7415-3fc7-4a33-b089-98b588e7b06c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:40.920125 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-228e7415-3fc7-4a33-b089-98b588e7b06c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:40.920558 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-228e7415-3fc7-4a33-b089-98b588e7b06c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:40.921256 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-228e7415-3fc7-4a33-b089-98b588e7b06c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:40.921741 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-228e7415-3fc7-4a33-b089-98b588e7b06c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:40.922168 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-228e7415-3fc7-4a33-b089-98b588e7b06c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:41.175415 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-228e7415-3fc7-4a33-b089-98b588e7b06c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:41.184769 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-228e7415-3fc7-4a33-b089-98b588e7b06c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.276257 Sep 04 16:18:41.185367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 325/656] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:40 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:42.213748 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d1b3dbe0-ed03-4fb4-a811-4fc5b79bc743 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:42.214393 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d1b3dbe0-ed03-4fb4-a811-4fc5b79bc743 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:42.221700 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1b3dbe0-ed03-4fb4-a811-4fc5b79bc743 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:42.226144 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1b3dbe0-ed03-4fb4-a811-4fc5b79bc743 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:42.226626 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1b3dbe0-ed03-4fb4-a811-4fc5b79bc743 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:42.228168 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1b3dbe0-ed03-4fb4-a811-4fc5b79bc743 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:42.232462 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1b3dbe0-ed03-4fb4-a811-4fc5b79bc743 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:42.232908 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d1b3dbe0-ed03-4fb4-a811-4fc5b79bc743 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:42.558506 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d1b3dbe0-ed03-4fb4-a811-4fc5b79bc743 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:42.568466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d1b3dbe0-ed03-4fb4-a811-4fc5b79bc743 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.359076 Sep 04 16:18:42.591864 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 332/657] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:42 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:42.949029 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3772d3d9-1abf-443b-899e-cfc63aec6205 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1436850623", "imageRef": "11a460f6-29b0-46e6-ae98-e53ee2e13520", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1fe4af06-d7bb-4218-9bf8-f19072fe6b17"}], "security_groups": [{"name": "tempest-securitygroup--934367290"}], "key_name": "tempest-keypair-229059128", "user_data": "}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:18:43.113237 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-3772d3d9-1abf-443b-899e-cfc63aec6205 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] validate_networks() for [('1fe4af06-d7bb-4218-9bf8-f19072fe6b17', None, None, None, None, None)] {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 16:18:43.596246 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b1f75c3a-e0a7-42e4-a4f6-aaa9547dac9c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:43.597476 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b1f75c3a-e0a7-42e4-a4f6-aaa9547dac9c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:43.613594 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1f75c3a-e0a7-42e4-a4f6-aaa9547dac9c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:43.614069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1f75c3a-e0a7-42e4-a4f6-aaa9547dac9c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:43.614499 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1f75c3a-e0a7-42e4-a4f6-aaa9547dac9c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:43.615194 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1f75c3a-e0a7-42e4-a4f6-aaa9547dac9c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:43.615644 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1f75c3a-e0a7-42e4-a4f6-aaa9547dac9c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:43.616064 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1f75c3a-e0a7-42e4-a4f6-aaa9547dac9c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:43.913830 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b1f75c3a-e0a7-42e4-a4f6-aaa9547dac9c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:43.926607 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b1f75c3a-e0a7-42e4-a4f6-aaa9547dac9c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.334108 Sep 04 16:18:43.941779 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 333/658] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:43 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:18:44.138425 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-3772d3d9-1abf-443b-899e-cfc63aec6205 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 16:18:44.138902 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-3772d3d9-1abf-443b-899e-cfc63aec6205 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 16:18:44.139102 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-3772d3d9-1abf-443b-899e-cfc63aec6205 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 16:18:44.139502 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-3772d3d9-1abf-443b-899e-cfc63aec6205 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 16:18:44.140089 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-3772d3d9-1abf-443b-899e-cfc63aec6205 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 16:18:44.152640 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3772d3d9-1abf-443b-899e-cfc63aec6205 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:44.153040 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3772d3d9-1abf-443b-899e-cfc63aec6205 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:44.153467 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3772d3d9-1abf-443b-899e-cfc63aec6205 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:44.154398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3772d3d9-1abf-443b-899e-cfc63aec6205 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:44.155008 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3772d3d9-1abf-443b-899e-cfc63aec6205 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:44.155588 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3772d3d9-1abf-443b-899e-cfc63aec6205 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:44.189901 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-3772d3d9-1abf-443b-899e-cfc63aec6205 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Getting quotas for project 1cc5ea4158344d5c8a35bc5783410620. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:18:44.194556 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-3772d3d9-1abf-443b-899e-cfc63aec6205 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Getting quotas for user 6e5c22b631df4600b9f920120b67fc67 and project 1cc5ea4158344d5c8a35bc5783410620. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:18:44.209496 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3772d3d9-1abf-443b-899e-cfc63aec6205 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 16:18:44.212774 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3772d3d9-1abf-443b-899e-cfc63aec6205 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a460f6-29b0-46e6-ae98-e53ee2e13520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 16:18:44.293740 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ef20fc48-d8bb-4f25-b5d6-cbdcfc988c41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1244030142", "imageRef": "11a460f6-29b0-46e6-ae98-e53ee2e13520", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d8e80fc6-ad05-43a4-89cd-45fef4a75dff"}], "security_groups": [{"name": "tempest-securitygroup--1009173493"}], "key_name": "tempest-keypair-1423648917", "user_data": "}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:18:44.327222 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3772d3d9-1abf-443b-899e-cfc63aec6205 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.384237 Sep 04 16:18:44.328493 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 326/659] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Sep 4 16:18:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 1386 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 16:18:44.348607 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d4e1c982-8c7e-45df-bdf5-380aa4fdd854 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:44.349816 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d4e1c982-8c7e-45df-bdf5-380aa4fdd854 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:44.450419 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d4e1c982-8c7e-45df-bdf5-380aa4fdd854 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:44.475203 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-ef20fc48-d8bb-4f25-b5d6-cbdcfc988c41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] validate_networks() for [('d8e80fc6-ad05-43a4-89cd-45fef4a75dff', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 16:18:44.481108 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d4e1c982-8c7e-45df-bdf5-380aa4fdd854 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1241 microversion: 2.1 time: 0.145527 Sep 04 16:18:44.486064 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 327/660] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:44 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1241 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:18:44.938946 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-ef20fc48-d8bb-4f25-b5d6-cbdcfc988c41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 16:18:44.939444 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-ef20fc48-d8bb-4f25-b5d6-cbdcfc988c41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 16:18:44.939863 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-ef20fc48-d8bb-4f25-b5d6-cbdcfc988c41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 16:18:44.940276 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-ef20fc48-d8bb-4f25-b5d6-cbdcfc988c41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 16:18:44.940687 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-ef20fc48-d8bb-4f25-b5d6-cbdcfc988c41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 16:18:44.950730 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef20fc48-d8bb-4f25-b5d6-cbdcfc988c41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:44.951210 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef20fc48-d8bb-4f25-b5d6-cbdcfc988c41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:44.951839 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef20fc48-d8bb-4f25-b5d6-cbdcfc988c41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:44.952570 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e56499c4-fb62-4f81-bf12-14739f925db0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:44.953034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef20fc48-d8bb-4f25-b5d6-cbdcfc988c41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:44.953419 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e56499c4-fb62-4f81-bf12-14739f925db0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:44.953719 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef20fc48-d8bb-4f25-b5d6-cbdcfc988c41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:44.959279 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ef20fc48-d8bb-4f25-b5d6-cbdcfc988c41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:44.959720 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e56499c4-fb62-4f81-bf12-14739f925db0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:44.960275 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e56499c4-fb62-4f81-bf12-14739f925db0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:44.960938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e56499c4-fb62-4f81-bf12-14739f925db0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:44.962896 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e56499c4-fb62-4f81-bf12-14739f925db0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:44.963374 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e56499c4-fb62-4f81-bf12-14739f925db0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:44.963953 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e56499c4-fb62-4f81-bf12-14739f925db0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:44.974968 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-ef20fc48-d8bb-4f25-b5d6-cbdcfc988c41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Getting quotas for project 3219dc7400ec4957a31b1b0fabfd8c56. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:18:44.980045 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-ef20fc48-d8bb-4f25-b5d6-cbdcfc988c41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Getting quotas for user 1623e93ad6844cacae7cc1a71b339f22 and project 3219dc7400ec4957a31b1b0fabfd8c56. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:18:44.993872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ef20fc48-d8bb-4f25-b5d6-cbdcfc988c41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 16:18:44.996516 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ef20fc48-d8bb-4f25-b5d6-cbdcfc988c41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a460f6-29b0-46e6-ae98-e53ee2e13520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 16:18:45.123794 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e56499c4-fb62-4f81-bf12-14739f925db0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:45.132460 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e56499c4-fb62-4f81-bf12-14739f925db0 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.183936 Sep 04 16:18:45.133039 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 328/661] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:44 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:18:45.508315 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ce0a2a70-a9e5-444e-939c-c0b5f84c55b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:45.509719 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ce0a2a70-a9e5-444e-939c-c0b5f84c55b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:45.528668 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ef20fc48-d8bb-4f25-b5d6-cbdcfc988c41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.239769 Sep 04 16:18:45.529674 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 334/662] 10.222.0.39 () {62 vars in 1188 bytes} [Sun Sep 4 16:18:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 04 16:18:45.554647 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c208c0d3-6dcc-41f2-9450-ea59ed2ebe89 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:45.555848 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c208c0d3-6dcc-41f2-9450-ea59ed2ebe89 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:45.570826 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ce0a2a70-a9e5-444e-939c-c0b5f84c55b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:45.578879 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ce0a2a70-a9e5-444e-939c-c0b5f84c55b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1241 microversion: 2.1 time: 0.074443 Sep 04 16:18:45.579452 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 329/663] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:45 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:18:45.626074 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c208c0d3-6dcc-41f2-9450-ea59ed2ebe89 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:45.636083 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c208c0d3-6dcc-41f2-9450-ea59ed2ebe89 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:45.637794 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c208c0d3-6dcc-41f2-9450-ea59ed2ebe89 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:45.639342 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c208c0d3-6dcc-41f2-9450-ea59ed2ebe89 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1282 microversion: 2.20 time: 0.094879 Sep 04 16:18:45.640082 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 335/664] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:18:45 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1282 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:18:46.160140 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-91b35659-6a0d-4b17-9d2c-12764d1f82e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:46.161230 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-91b35659-6a0d-4b17-9d2c-12764d1f82e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:46.169472 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-91b35659-6a0d-4b17-9d2c-12764d1f82e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:46.169991 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-91b35659-6a0d-4b17-9d2c-12764d1f82e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:46.171106 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-91b35659-6a0d-4b17-9d2c-12764d1f82e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:46.171863 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-91b35659-6a0d-4b17-9d2c-12764d1f82e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:46.172324 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-91b35659-6a0d-4b17-9d2c-12764d1f82e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:46.172751 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-91b35659-6a0d-4b17-9d2c-12764d1f82e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:46.304431 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-91b35659-6a0d-4b17-9d2c-12764d1f82e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:46.314124 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-91b35659-6a0d-4b17-9d2c-12764d1f82e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.157746 Sep 04 16:18:46.318030 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 330/665] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:46 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:46.438162 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-995e0dc9-6b75-4821-8006-edca8cc5fca8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Action: 'create', calling method: .version_select at 0x7f96891bd0d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-451834545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACKL2gsGhbhzLX6XUnHRx/bA4aZ46qA64sG8VoumS1mw1Lm5/o0pcmAxDXVUH8lE6M7LWdrPU7J2dAspcqpCoh/7kzCRR2zkggRw5LAFjxPVbeN/zSltuspPrLECJqpOw=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:18:46.454818 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-995e0dc9-6b75-4821-8006-edca8cc5fca8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Getting quotas for project ae092c3124e9438fa20dfda624775825. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:18:46.458394 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-995e0dc9-6b75-4821-8006-edca8cc5fca8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Getting quotas for user 9b17d0d51b034064a98bdae4bbc20fb6 and project ae092c3124e9438fa20dfda624775825. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:18:46.566717 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-995e0dc9-6b75-4821-8006-edca8cc5fca8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.132303 Sep 04 16:18:46.567334 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 336/666] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Sep 4 16:18:46 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:18:46.605234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-518a5a3d-3870-43be-9036-93bd4b903ec4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:46.608849 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-518a5a3d-3870-43be-9036-93bd4b903ec4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:46.619556 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-518a5a3d-3870-43be-9036-93bd4b903ec4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:46.620189 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-518a5a3d-3870-43be-9036-93bd4b903ec4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:46.620615 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-518a5a3d-3870-43be-9036-93bd4b903ec4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:46.622259 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-95092a0e-bc8e-4016-99df-c483e83e4894 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1658879262", "imageRef": "7e96ceea-4ff9-46c8-ba45-7f254eaedf0e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-451834545", "networks": [{"uuid": "363bb28e-4d9e-4c6d-90a2-d8bcab58307b"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:18:46.624323 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-518a5a3d-3870-43be-9036-93bd4b903ec4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:46.625091 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-518a5a3d-3870-43be-9036-93bd4b903ec4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:46.625929 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-518a5a3d-3870-43be-9036-93bd4b903ec4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:46.690485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-95092a0e-bc8e-4016-99df-c483e83e4894 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] validate_networks() for [('363bb28e-4d9e-4c6d-90a2-d8bcab58307b', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 16:18:46.702953 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-518a5a3d-3870-43be-9036-93bd4b903ec4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:46.711718 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-518a5a3d-3870-43be-9036-93bd4b903ec4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1293 microversion: 2.1 time: 0.113028 Sep 04 16:18:46.712792 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 331/667] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:46 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1293 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:46.784284 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1392cd55-d371-49e2-b4aa-7c7298e378c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:46.784897 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1392cd55-d371-49e2-b4aa-7c7298e378c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:46.791903 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1392cd55-d371-49e2-b4aa-7c7298e378c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:46.792393 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1392cd55-d371-49e2-b4aa-7c7298e378c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:46.793240 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1392cd55-d371-49e2-b4aa-7c7298e378c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:46.793967 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1392cd55-d371-49e2-b4aa-7c7298e378c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:46.794426 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1392cd55-d371-49e2-b4aa-7c7298e378c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:46.795005 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1392cd55-d371-49e2-b4aa-7c7298e378c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:46.879961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1392cd55-d371-49e2-b4aa-7c7298e378c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:46.889168 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1392cd55-d371-49e2-b4aa-7c7298e378c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:46.890661 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1392cd55-d371-49e2-b4aa-7c7298e378c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:46.891769 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1392cd55-d371-49e2-b4aa-7c7298e378c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1286 microversion: 2.20 time: 0.177968 Sep 04 16:18:46.892615 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 332/668] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:18:46 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1286 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:18:47.096627 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-95092a0e-bc8e-4016-99df-c483e83e4894 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 16:18:47.098193 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-95092a0e-bc8e-4016-99df-c483e83e4894 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 16:18:47.098193 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-95092a0e-bc8e-4016-99df-c483e83e4894 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 16:18:47.098193 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-95092a0e-bc8e-4016-99df-c483e83e4894 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 16:18:47.098506 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-95092a0e-bc8e-4016-99df-c483e83e4894 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 16:18:47.109457 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95092a0e-bc8e-4016-99df-c483e83e4894 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:47.110261 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95092a0e-bc8e-4016-99df-c483e83e4894 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:47.110939 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95092a0e-bc8e-4016-99df-c483e83e4894 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:47.112067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95092a0e-bc8e-4016-99df-c483e83e4894 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:47.112737 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95092a0e-bc8e-4016-99df-c483e83e4894 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:47.113480 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-95092a0e-bc8e-4016-99df-c483e83e4894 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:47.130864 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-95092a0e-bc8e-4016-99df-c483e83e4894 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Getting quotas for project ae092c3124e9438fa20dfda624775825. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:18:47.132327 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:18:47.136312 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-95092a0e-bc8e-4016-99df-c483e83e4894 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Getting quotas for user 9b17d0d51b034064a98bdae4bbc20fb6 and project ae092c3124e9438fa20dfda624775825. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:18:47.148448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-95092a0e-bc8e-4016-99df-c483e83e4894 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 16:18:47.151462 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-95092a0e-bc8e-4016-99df-c483e83e4894 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7e96ceea-4ff9-46c8-ba45-7f254eaedf0e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 16:18:47.259786 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-95092a0e-bc8e-4016-99df-c483e83e4894 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642262 Sep 04 16:18:47.266313 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 337/669] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Sep 4 16:18:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 04 16:18:47.271434 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-54310bbd-5082-4e04-8651-8962d24150b8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:47.275210 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-54310bbd-5082-4e04-8651-8962d24150b8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:47.339395 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1b0f3768-ec7b-4b7f-b988-ef1c5acf5a37 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:47.340009 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1b0f3768-ec7b-4b7f-b988-ef1c5acf5a37 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:47.348207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b0f3768-ec7b-4b7f-b988-ef1c5acf5a37 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:47.348938 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b0f3768-ec7b-4b7f-b988-ef1c5acf5a37 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:47.349386 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b0f3768-ec7b-4b7f-b988-ef1c5acf5a37 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:47.350153 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b0f3768-ec7b-4b7f-b988-ef1c5acf5a37 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:47.350606 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b0f3768-ec7b-4b7f-b988-ef1c5acf5a37 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:47.351448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1b0f3768-ec7b-4b7f-b988-ef1c5acf5a37 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:47.407252 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-54310bbd-5082-4e04-8651-8962d24150b8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:47.418632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-54310bbd-5082-4e04-8651-8962d24150b8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1258 microversion: 2.1 time: 0.149673 Sep 04 16:18:47.418632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 333/670] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:47 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:18:47.551901 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1b0f3768-ec7b-4b7f-b988-ef1c5acf5a37 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:47.560929 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1b0f3768-ec7b-4b7f-b988-ef1c5acf5a37 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.225870 Sep 04 16:18:47.561497 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 338/671] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:47 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:18:47.735826 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2fd996a3-6cbf-4d70-bf37-cc946a027fd1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:47.736554 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2fd996a3-6cbf-4d70-bf37-cc946a027fd1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:47.743885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fd996a3-6cbf-4d70-bf37-cc946a027fd1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:47.744636 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fd996a3-6cbf-4d70-bf37-cc946a027fd1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:47.745116 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fd996a3-6cbf-4d70-bf37-cc946a027fd1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:47.745846 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fd996a3-6cbf-4d70-bf37-cc946a027fd1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:47.746304 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fd996a3-6cbf-4d70-bf37-cc946a027fd1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:47.746734 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2fd996a3-6cbf-4d70-bf37-cc946a027fd1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:47.851441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2fd996a3-6cbf-4d70-bf37-cc946a027fd1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:47.861154 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2fd996a3-6cbf-4d70-bf37-cc946a027fd1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1299 microversion: 2.1 time: 0.129190 Sep 04 16:18:47.863284 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 334/672] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:47 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1299 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:47.918881 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-68aa0fd4-1377-478b-930c-b6934ccc39f4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:47.919490 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-68aa0fd4-1377-478b-930c-b6934ccc39f4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:47.928663 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68aa0fd4-1377-478b-930c-b6934ccc39f4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:47.929144 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68aa0fd4-1377-478b-930c-b6934ccc39f4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:47.931652 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68aa0fd4-1377-478b-930c-b6934ccc39f4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:47.931652 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68aa0fd4-1377-478b-930c-b6934ccc39f4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:47.931652 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68aa0fd4-1377-478b-930c-b6934ccc39f4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:47.931652 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-68aa0fd4-1377-478b-930c-b6934ccc39f4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:47.995328 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-68aa0fd4-1377-478b-930c-b6934ccc39f4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:48.003413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-68aa0fd4-1377-478b-930c-b6934ccc39f4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:48.004869 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-68aa0fd4-1377-478b-930c-b6934ccc39f4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:48.005998 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-68aa0fd4-1377-478b-930c-b6934ccc39f4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1334 microversion: 2.20 time: 0.093462 Sep 04 16:18:48.006559 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 339/673] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:18:47 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1334 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:18:48.440517 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f5547089-8c53-4fe5-b311-9f796530e360 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:48.441158 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f5547089-8c53-4fe5-b311-9f796530e360 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:48.531550 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f5547089-8c53-4fe5-b311-9f796530e360 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:48.538625 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f5547089-8c53-4fe5-b311-9f796530e360 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1258 microversion: 2.1 time: 0.101964 Sep 04 16:18:48.539398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 335/674] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:48 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1258 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:48.584714 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a1241a98-120f-4d3c-babc-33f4e778bb40 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:48.585408 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a1241a98-120f-4d3c-babc-33f4e778bb40 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:48.593253 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a1241a98-120f-4d3c-babc-33f4e778bb40 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:48.593871 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a1241a98-120f-4d3c-babc-33f4e778bb40 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:48.594365 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a1241a98-120f-4d3c-babc-33f4e778bb40 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:48.595345 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a1241a98-120f-4d3c-babc-33f4e778bb40 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:48.596956 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a1241a98-120f-4d3c-babc-33f4e778bb40 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:48.598600 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a1241a98-120f-4d3c-babc-33f4e778bb40 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:48.864872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a1241a98-120f-4d3c-babc-33f4e778bb40 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:48.876406 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a1241a98-120f-4d3c-babc-33f4e778bb40 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.295782 Sep 04 16:18:48.879913 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 340/675] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:48 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:48.884617 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5c6de7de-a65a-44f0-b6a7-ac4e4a17a4dd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:48.885238 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5c6de7de-a65a-44f0-b6a7-ac4e4a17a4dd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:48.891610 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5c6de7de-a65a-44f0-b6a7-ac4e4a17a4dd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:48.892116 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5c6de7de-a65a-44f0-b6a7-ac4e4a17a4dd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:48.892802 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5c6de7de-a65a-44f0-b6a7-ac4e4a17a4dd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:48.893557 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5c6de7de-a65a-44f0-b6a7-ac4e4a17a4dd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:48.894036 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5c6de7de-a65a-44f0-b6a7-ac4e4a17a4dd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:48.894463 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5c6de7de-a65a-44f0-b6a7-ac4e4a17a4dd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:49.032411 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-359f8dec-d594-4476-9ee1-443031186a2e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:49.033045 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-359f8dec-d594-4476-9ee1-443031186a2e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:49.039564 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-359f8dec-d594-4476-9ee1-443031186a2e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:49.040747 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-359f8dec-d594-4476-9ee1-443031186a2e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:49.041385 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-359f8dec-d594-4476-9ee1-443031186a2e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:49.042323 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-359f8dec-d594-4476-9ee1-443031186a2e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:49.043576 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-359f8dec-d594-4476-9ee1-443031186a2e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:49.044248 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-359f8dec-d594-4476-9ee1-443031186a2e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:49.134262 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-359f8dec-d594-4476-9ee1-443031186a2e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:49.144510 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-359f8dec-d594-4476-9ee1-443031186a2e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:49.146512 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-359f8dec-d594-4476-9ee1-443031186a2e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:49.147781 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-359f8dec-d594-4476-9ee1-443031186a2e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1340 microversion: 2.20 time: 0.119384 Sep 04 16:18:49.148336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 341/676] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:18:49 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1340 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:18:49.204077 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5c6de7de-a65a-44f0-b6a7-ac4e4a17a4dd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:49.214557 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5c6de7de-a65a-44f0-b6a7-ac4e4a17a4dd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1366 microversion: 2.1 time: 0.331931 Sep 04 16:18:49.215157 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 336/677] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:48 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:49.561844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-33da5510-7fae-409d-a9fc-9e6be13a8174 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:49.562547 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-33da5510-7fae-409d-a9fc-9e6be13a8174 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:49.569146 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33da5510-7fae-409d-a9fc-9e6be13a8174 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:49.569795 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33da5510-7fae-409d-a9fc-9e6be13a8174 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:49.570296 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33da5510-7fae-409d-a9fc-9e6be13a8174 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:49.571141 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33da5510-7fae-409d-a9fc-9e6be13a8174 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:49.571944 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33da5510-7fae-409d-a9fc-9e6be13a8174 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:49.572438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-33da5510-7fae-409d-a9fc-9e6be13a8174 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:49.582845 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-a7a456c3-a57c-4c96-8fa5-1b73bc5d29b0 req-42d6a158-ef48-44b9-a20d-9e6e482d04b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e5636f2-5f2f-45ca-af8a-d998079502df", "tag": "5109bc3e-5bc8-407d-b0e7-4d3d700d2044"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:18:49.604892 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-a7a456c3-a57c-4c96-8fa5-1b73bc5d29b0 req-42d6a158-ef48-44b9-a20d-9e6e482d04b6 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:49.605429 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-a7a456c3-a57c-4c96-8fa5-1b73bc5d29b0 req-42d6a158-ef48-44b9-a20d-9e6e482d04b6 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:49.605879 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-a7a456c3-a57c-4c96-8fa5-1b73bc5d29b0 req-42d6a158-ef48-44b9-a20d-9e6e482d04b6 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:49.620374 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-a7a456c3-a57c-4c96-8fa5-1b73bc5d29b0 req-42d6a158-ef48-44b9-a20d-9e6e482d04b6 service nova] Creating event network-changed:5109bc3e-5bc8-407d-b0e7-4d3d700d2044 for instance 9e5636f2-5f2f-45ca-af8a-d998079502df on hv-cinder-85236 Sep 04 16:18:49.626561 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-a7a456c3-a57c-4c96-8fa5-1b73bc5d29b0 req-42d6a158-ef48-44b9-a20d-9e6e482d04b6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047839 Sep 04 16:18:49.626922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 337/678] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:18:49.675870 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-33da5510-7fae-409d-a9fc-9e6be13a8174 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:49.684601 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-33da5510-7fae-409d-a9fc-9e6be13a8174 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1310 microversion: 2.1 time: 0.126604 Sep 04 16:18:49.685827 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 342/679] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:49 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1310 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:49.907343 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-45291ff9-162c-4a5f-a4a0-cf865af4c1ec tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:49.908040 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-45291ff9-162c-4a5f-a4a0-cf865af4c1ec tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:49.914223 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45291ff9-162c-4a5f-a4a0-cf865af4c1ec tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:49.914761 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45291ff9-162c-4a5f-a4a0-cf865af4c1ec tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:49.915740 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45291ff9-162c-4a5f-a4a0-cf865af4c1ec tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:49.916696 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45291ff9-162c-4a5f-a4a0-cf865af4c1ec tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:49.917148 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45291ff9-162c-4a5f-a4a0-cf865af4c1ec tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:49.917589 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45291ff9-162c-4a5f-a4a0-cf865af4c1ec tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:50.176660 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-85e221c6-da8e-4feb-83cc-ecafb1010fac tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:50.177382 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-85e221c6-da8e-4feb-83cc-ecafb1010fac tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:50.184845 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85e221c6-da8e-4feb-83cc-ecafb1010fac tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:50.185335 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85e221c6-da8e-4feb-83cc-ecafb1010fac tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:50.185818 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85e221c6-da8e-4feb-83cc-ecafb1010fac tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:50.186525 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85e221c6-da8e-4feb-83cc-ecafb1010fac tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:50.186983 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85e221c6-da8e-4feb-83cc-ecafb1010fac tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:50.187403 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85e221c6-da8e-4feb-83cc-ecafb1010fac tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:50.549027 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-45291ff9-162c-4a5f-a4a0-cf865af4c1ec tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:50.558444 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-45291ff9-162c-4a5f-a4a0-cf865af4c1ec tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.655653 Sep 04 16:18:50.559171 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 338/680] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:49 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:50.563808 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-935d86a3-8135-434a-b5e8-5e45f40ca56f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:50.564490 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-935d86a3-8135-434a-b5e8-5e45f40ca56f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:50.570843 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-935d86a3-8135-434a-b5e8-5e45f40ca56f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:50.571477 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-935d86a3-8135-434a-b5e8-5e45f40ca56f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:50.572218 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-935d86a3-8135-434a-b5e8-5e45f40ca56f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:50.572925 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-935d86a3-8135-434a-b5e8-5e45f40ca56f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:50.573379 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-935d86a3-8135-434a-b5e8-5e45f40ca56f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:50.573833 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-935d86a3-8135-434a-b5e8-5e45f40ca56f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:50.580165 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-85e221c6-da8e-4feb-83cc-ecafb1010fac tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:50.590244 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-85e221c6-da8e-4feb-83cc-ecafb1010fac tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:50.591747 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-85e221c6-da8e-4feb-83cc-ecafb1010fac tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:50.592847 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-85e221c6-da8e-4feb-83cc-ecafb1010fac tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1408 microversion: 2.20 time: 0.422115 Sep 04 16:18:50.593452 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 343/681] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:18:50 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1408 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:18:50.715147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-70e5098e-692b-49e2-b877-c8327619bf97 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:50.715750 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-70e5098e-692b-49e2-b877-c8327619bf97 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:50.721519 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70e5098e-692b-49e2-b877-c8327619bf97 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:50.722029 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70e5098e-692b-49e2-b877-c8327619bf97 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:50.722454 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70e5098e-692b-49e2-b877-c8327619bf97 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:50.723137 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70e5098e-692b-49e2-b877-c8327619bf97 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:50.723580 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70e5098e-692b-49e2-b877-c8327619bf97 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:50.723994 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-70e5098e-692b-49e2-b877-c8327619bf97 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:50.815241 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-70e5098e-692b-49e2-b877-c8327619bf97 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:50.823004 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-70e5098e-692b-49e2-b877-c8327619bf97 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1316 microversion: 2.1 time: 0.112450 Sep 04 16:18:50.823584 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 344/682] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:50 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1316 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:18:50.830092 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-935d86a3-8135-434a-b5e8-5e45f40ca56f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:50.834210 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-935d86a3-8135-434a-b5e8-5e45f40ca56f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1366 microversion: 2.1 time: 0.273897 Sep 04 16:18:50.835187 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 339/683] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:50 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:51.585494 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-17561299-d877-46df-b0a3-1cf074c1d5ba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:51.586242 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-17561299-d877-46df-b0a3-1cf074c1d5ba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:51.603493 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17561299-d877-46df-b0a3-1cf074c1d5ba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:51.604667 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17561299-d877-46df-b0a3-1cf074c1d5ba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:51.605943 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17561299-d877-46df-b0a3-1cf074c1d5ba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:51.607288 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17561299-d877-46df-b0a3-1cf074c1d5ba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:51.608355 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17561299-d877-46df-b0a3-1cf074c1d5ba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:51.609070 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-17561299-d877-46df-b0a3-1cf074c1d5ba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:51.619582 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5edc2c2c-20b6-48c5-8306-7f5753ea01ab tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:51.620726 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5edc2c2c-20b6-48c5-8306-7f5753ea01ab tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:51.632986 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5edc2c2c-20b6-48c5-8306-7f5753ea01ab tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:51.633513 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5edc2c2c-20b6-48c5-8306-7f5753ea01ab tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:51.634220 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5edc2c2c-20b6-48c5-8306-7f5753ea01ab tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:51.635269 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5edc2c2c-20b6-48c5-8306-7f5753ea01ab tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:51.635921 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5edc2c2c-20b6-48c5-8306-7f5753ea01ab tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:51.636539 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5edc2c2c-20b6-48c5-8306-7f5753ea01ab tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:51.641337 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:18:52.020433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-17561299-d877-46df-b0a3-1cf074c1d5ba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:52.034034 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5edc2c2c-20b6-48c5-8306-7f5753ea01ab tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:52.043179 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:18:52.053335 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5edc2c2c-20b6-48c5-8306-7f5753ea01ab tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:52.056538 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-17561299-d877-46df-b0a3-1cf074c1d5ba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.477428 Sep 04 16:18:52.058306 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5edc2c2c-20b6-48c5-8306-7f5753ea01ab tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:52.059541 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5edc2c2c-20b6-48c5-8306-7f5753ea01ab tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1408 microversion: 2.20 time: 0.443942 Sep 04 16:18:52.076944 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 345/684] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:51 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:18:52.082373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-8d0f0434-3d44-4f6e-9e7f-d25d7caf5b88 req-bafcf92f-ab96-42ab-b173-fc91a10d9e31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73", "tag": "6d210ca9-1ff4-4f3e-842e-652e252e69a7"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:18:52.083717 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 340/685] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:18:51 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1408 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:18:52.111520 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7c2f585c-4307-4322-83c0-45c5024ca7a7 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:52.111520 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7c2f585c-4307-4322-83c0-45c5024ca7a7 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:52.117059 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8d0f0434-3d44-4f6e-9e7f-d25d7caf5b88 req-bafcf92f-ab96-42ab-b173-fc91a10d9e31 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:52.117681 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8d0f0434-3d44-4f6e-9e7f-d25d7caf5b88 req-bafcf92f-ab96-42ab-b173-fc91a10d9e31 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:52.118660 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8d0f0434-3d44-4f6e-9e7f-d25d7caf5b88 req-bafcf92f-ab96-42ab-b173-fc91a10d9e31 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:52.127272 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7c2f585c-4307-4322-83c0-45c5024ca7a7 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:52.132089 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-8d0f0434-3d44-4f6e-9e7f-d25d7caf5b88 req-bafcf92f-ab96-42ab-b173-fc91a10d9e31 service nova] Creating event network-changed:6d210ca9-1ff4-4f3e-842e-652e252e69a7 for instance ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 on hv-cinder-85236 Sep 04 16:18:52.132752 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7c2f585c-4307-4322-83c0-45c5024ca7a7 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:52.141758 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7c2f585c-4307-4322-83c0-45c5024ca7a7 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:52.143266 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7c2f585c-4307-4322-83c0-45c5024ca7a7 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:52.143798 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7c2f585c-4307-4322-83c0-45c5024ca7a7 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:52.145507 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7c2f585c-4307-4322-83c0-45c5024ca7a7 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:52.154170 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-8d0f0434-3d44-4f6e-9e7f-d25d7caf5b88 req-bafcf92f-ab96-42ab-b173-fc91a10d9e31 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073518 Sep 04 16:18:52.155992 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 346/686] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:18:52.167421 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-208512c9-6c77-42ca-b193-54686fe56c58 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:52.168140 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-208512c9-6c77-42ca-b193-54686fe56c58 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:52.189056 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-208512c9-6c77-42ca-b193-54686fe56c58 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:52.189576 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-208512c9-6c77-42ca-b193-54686fe56c58 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:52.192928 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-208512c9-6c77-42ca-b193-54686fe56c58 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:52.195145 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-208512c9-6c77-42ca-b193-54686fe56c58 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:52.195706 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-208512c9-6c77-42ca-b193-54686fe56c58 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:52.196169 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-208512c9-6c77-42ca-b193-54686fe56c58 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:52.491217 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7c2f585c-4307-4322-83c0-45c5024ca7a7 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:52.501260 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7c2f585c-4307-4322-83c0-45c5024ca7a7 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1358 microversion: 2.1 time: 0.416168 Sep 04 16:18:52.501932 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 341/687] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:52 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1358 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:52.546109 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-208512c9-6c77-42ca-b193-54686fe56c58 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:52.560810 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-208512c9-6c77-42ca-b193-54686fe56c58 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1366 microversion: 2.1 time: 0.403435 Sep 04 16:18:52.561728 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 347/688] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:52 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1366 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:53.083703 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a2d8b926-6e30-46a5-bb61-b3ae5e12f503 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:53.084365 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a2d8b926-6e30-46a5-bb61-b3ae5e12f503 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:53.091430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a2d8b926-6e30-46a5-bb61-b3ae5e12f503 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:53.091922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a2d8b926-6e30-46a5-bb61-b3ae5e12f503 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:53.094115 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a2d8b926-6e30-46a5-bb61-b3ae5e12f503 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:53.094897 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a2d8b926-6e30-46a5-bb61-b3ae5e12f503 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:53.095371 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a2d8b926-6e30-46a5-bb61-b3ae5e12f503 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:53.095805 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a2d8b926-6e30-46a5-bb61-b3ae5e12f503 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:53.119916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8a23e0c8-3e1e-429a-933f-05933bcbab48 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:53.120701 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8a23e0c8-3e1e-429a-933f-05933bcbab48 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:53.130949 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a23e0c8-3e1e-429a-933f-05933bcbab48 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:53.131651 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a23e0c8-3e1e-429a-933f-05933bcbab48 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:53.132473 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a23e0c8-3e1e-429a-933f-05933bcbab48 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:53.135836 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a23e0c8-3e1e-429a-933f-05933bcbab48 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:53.136560 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a23e0c8-3e1e-429a-933f-05933bcbab48 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:53.137253 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a23e0c8-3e1e-429a-933f-05933bcbab48 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:53.325069 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a2d8b926-6e30-46a5-bb61-b3ae5e12f503 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:53.333384 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a2d8b926-6e30-46a5-bb61-b3ae5e12f503 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.253432 Sep 04 16:18:53.334055 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 342/689] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:53 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:53.353412 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-8a23e0c8-3e1e-429a-933f-05933bcbab48 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:53.361476 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-8a23e0c8-3e1e-429a-933f-05933bcbab48 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:53.362956 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-8a23e0c8-3e1e-429a-933f-05933bcbab48 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:53.364052 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8a23e0c8-3e1e-429a-933f-05933bcbab48 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1408 microversion: 2.20 time: 0.253423 Sep 04 16:18:53.364603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 348/690] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:18:53 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1408 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:18:53.525512 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-96760878-51cf-4580-9bd9-35a4108d6b4b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:53.526232 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-96760878-51cf-4580-9bd9-35a4108d6b4b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:53.534438 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-96760878-51cf-4580-9bd9-35a4108d6b4b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:53.535388 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-96760878-51cf-4580-9bd9-35a4108d6b4b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:53.535855 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-96760878-51cf-4580-9bd9-35a4108d6b4b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:53.536943 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-96760878-51cf-4580-9bd9-35a4108d6b4b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:53.537502 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-96760878-51cf-4580-9bd9-35a4108d6b4b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:53.538100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-96760878-51cf-4580-9bd9-35a4108d6b4b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:53.585874 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5eb662e1-e019-4e04-b898-635e75f4d455 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:53.586495 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5eb662e1-e019-4e04-b898-635e75f4d455 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:53.594712 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5eb662e1-e019-4e04-b898-635e75f4d455 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:53.595425 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5eb662e1-e019-4e04-b898-635e75f4d455 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:53.595839 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5eb662e1-e019-4e04-b898-635e75f4d455 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:53.596881 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5eb662e1-e019-4e04-b898-635e75f4d455 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:53.597525 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5eb662e1-e019-4e04-b898-635e75f4d455 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:53.598149 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5eb662e1-e019-4e04-b898-635e75f4d455 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:53.760215 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-96760878-51cf-4580-9bd9-35a4108d6b4b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:53.769663 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-96760878-51cf-4580-9bd9-35a4108d6b4b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1358 microversion: 2.1 time: 0.249091 Sep 04 16:18:53.785242 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 343/691] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:53 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1358 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:53.787956 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5eb662e1-e019-4e04-b898-635e75f4d455 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:53.796647 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5eb662e1-e019-4e04-b898-635e75f4d455 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1366 microversion: 2.1 time: 0.214986 Sep 04 16:18:53.797231 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 349/692] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:53 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:54.359364 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:18:54.414159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-461df3e1-1c16-43b1-8748-1c60dd515b24 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:54.414159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-461df3e1-1c16-43b1-8748-1c60dd515b24 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:54.414159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-461df3e1-1c16-43b1-8748-1c60dd515b24 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:54.414159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-461df3e1-1c16-43b1-8748-1c60dd515b24 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:54.415621 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-461df3e1-1c16-43b1-8748-1c60dd515b24 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:54.415621 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-461df3e1-1c16-43b1-8748-1c60dd515b24 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:54.415621 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-461df3e1-1c16-43b1-8748-1c60dd515b24 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:54.415621 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-461df3e1-1c16-43b1-8748-1c60dd515b24 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:54.521268 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f7ef2196-4ac3-480d-b572-b37ce0999584 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:54.522065 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f7ef2196-4ac3-480d-b572-b37ce0999584 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:54.536152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f7ef2196-4ac3-480d-b572-b37ce0999584 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:54.536572 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f7ef2196-4ac3-480d-b572-b37ce0999584 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:54.537451 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f7ef2196-4ac3-480d-b572-b37ce0999584 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:54.537899 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f7ef2196-4ac3-480d-b572-b37ce0999584 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:54.538396 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f7ef2196-4ac3-480d-b572-b37ce0999584 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:54.538849 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f7ef2196-4ac3-480d-b572-b37ce0999584 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:54.582478 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-461df3e1-1c16-43b1-8748-1c60dd515b24 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:54.591228 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-461df3e1-1c16-43b1-8748-1c60dd515b24 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:54.592668 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-461df3e1-1c16-43b1-8748-1c60dd515b24 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:54.593803 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-461df3e1-1c16-43b1-8748-1c60dd515b24 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1408 microversion: 2.20 time: 0.206761 Sep 04 16:18:54.594369 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 350/693] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:18:54 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1408 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:18:54.714508 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f7ef2196-4ac3-480d-b572-b37ce0999584 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:54.720556 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f7ef2196-4ac3-480d-b572-b37ce0999584 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.367943 Sep 04 16:18:54.721139 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 344/694] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:54 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:54.793122 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-54350321-8cf6-46d6-a5d4-2564b4a851cd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:54.793776 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-54350321-8cf6-46d6-a5d4-2564b4a851cd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:54.799683 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54350321-8cf6-46d6-a5d4-2564b4a851cd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:54.803243 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54350321-8cf6-46d6-a5d4-2564b4a851cd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:54.803243 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54350321-8cf6-46d6-a5d4-2564b4a851cd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:54.803243 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54350321-8cf6-46d6-a5d4-2564b4a851cd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:54.803243 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54350321-8cf6-46d6-a5d4-2564b4a851cd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:54.803611 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-54350321-8cf6-46d6-a5d4-2564b4a851cd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:54.877836 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8b30c803-792f-4cf2-ad46-c92497a426e0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:54.878449 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8b30c803-792f-4cf2-ad46-c92497a426e0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:54.893789 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8b30c803-792f-4cf2-ad46-c92497a426e0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:54.894209 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8b30c803-792f-4cf2-ad46-c92497a426e0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:54.894650 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8b30c803-792f-4cf2-ad46-c92497a426e0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:54.895373 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8b30c803-792f-4cf2-ad46-c92497a426e0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:54.895819 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8b30c803-792f-4cf2-ad46-c92497a426e0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:54.896241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8b30c803-792f-4cf2-ad46-c92497a426e0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:54.968895 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-54350321-8cf6-46d6-a5d4-2564b4a851cd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:54.976543 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-54350321-8cf6-46d6-a5d4-2564b4a851cd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1358 microversion: 2.1 time: 0.187926 Sep 04 16:18:54.979865 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 351/695] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:54 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:55.060796 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8b30c803-792f-4cf2-ad46-c92497a426e0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:55.077752 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8b30c803-792f-4cf2-ad46-c92497a426e0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1366 microversion: 2.1 time: 0.261202 Sep 04 16:18:55.078345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 345/696] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:54 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:18:55.620727 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-46a51c6e-02a6-497a-a94e-1f64e1c8f51c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:55.621496 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-46a51c6e-02a6-497a-a94e-1f64e1c8f51c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:55.628471 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46a51c6e-02a6-497a-a94e-1f64e1c8f51c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:55.629102 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46a51c6e-02a6-497a-a94e-1f64e1c8f51c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:55.629678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46a51c6e-02a6-497a-a94e-1f64e1c8f51c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:55.630487 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46a51c6e-02a6-497a-a94e-1f64e1c8f51c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:55.631060 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46a51c6e-02a6-497a-a94e-1f64e1c8f51c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:55.631576 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46a51c6e-02a6-497a-a94e-1f64e1c8f51c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:55.746389 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cd6e0e01-55b5-4685-a1b7-658b795219ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:55.747754 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cd6e0e01-55b5-4685-a1b7-658b795219ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:55.749869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:18:55.754541 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd6e0e01-55b5-4685-a1b7-658b795219ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:55.755030 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd6e0e01-55b5-4685-a1b7-658b795219ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:55.755465 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd6e0e01-55b5-4685-a1b7-658b795219ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:55.756181 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd6e0e01-55b5-4685-a1b7-658b795219ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:55.756642 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd6e0e01-55b5-4685-a1b7-658b795219ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:55.757068 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd6e0e01-55b5-4685-a1b7-658b795219ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:55.789581 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-46a51c6e-02a6-497a-a94e-1f64e1c8f51c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:55.798405 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-46a51c6e-02a6-497a-a94e-1f64e1c8f51c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:55.804009 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-46a51c6e-02a6-497a-a94e-1f64e1c8f51c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:55.804009 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-46a51c6e-02a6-497a-a94e-1f64e1c8f51c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1408 microversion: 2.20 time: 0.185428 Sep 04 16:18:55.804009 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 352/697] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:18:55 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:18:55.897480 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-cd6e0e01-55b5-4685-a1b7-658b795219ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:55.906322 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cd6e0e01-55b5-4685-a1b7-658b795219ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.164570 Sep 04 16:18:55.908749 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 346/698] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:55 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:18:56.000054 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e48a442c-f24e-4aef-916a-beee0ca3515c tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:56.000662 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e48a442c-f24e-4aef-916a-beee0ca3515c tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:56.006913 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e48a442c-f24e-4aef-916a-beee0ca3515c tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:56.007404 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e48a442c-f24e-4aef-916a-beee0ca3515c tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:56.007982 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e48a442c-f24e-4aef-916a-beee0ca3515c tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:56.009311 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e48a442c-f24e-4aef-916a-beee0ca3515c tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:56.009806 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e48a442c-f24e-4aef-916a-beee0ca3515c tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:56.010233 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e48a442c-f24e-4aef-916a-beee0ca3515c tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:56.106057 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d901243a-e651-434e-8cd6-c830255a3b99 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:56.107183 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d901243a-e651-434e-8cd6-c830255a3b99 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:56.114304 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d901243a-e651-434e-8cd6-c830255a3b99 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:56.115144 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d901243a-e651-434e-8cd6-c830255a3b99 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:56.115794 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d901243a-e651-434e-8cd6-c830255a3b99 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:56.116712 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d901243a-e651-434e-8cd6-c830255a3b99 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:56.117387 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d901243a-e651-434e-8cd6-c830255a3b99 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:56.118642 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d901243a-e651-434e-8cd6-c830255a3b99 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:56.177084 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e48a442c-f24e-4aef-916a-beee0ca3515c tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:56.185438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e48a442c-f24e-4aef-916a-beee0ca3515c tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1358 microversion: 2.1 time: 0.189269 Sep 04 16:18:56.186069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 353/699] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:55 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:56.272961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d901243a-e651-434e-8cd6-c830255a3b99 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:56.284884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d901243a-e651-434e-8cd6-c830255a3b99 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1366 microversion: 2.1 time: 0.182646 Sep 04 16:18:56.285473 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 347/700] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:56 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:18:56.827140 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d54ad6d3-7545-47c9-a8ff-2255091542ec tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:56.827745 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d54ad6d3-7545-47c9-a8ff-2255091542ec tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:56.834330 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d54ad6d3-7545-47c9-a8ff-2255091542ec tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:56.834814 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d54ad6d3-7545-47c9-a8ff-2255091542ec tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:56.835250 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d54ad6d3-7545-47c9-a8ff-2255091542ec tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:56.836100 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d54ad6d3-7545-47c9-a8ff-2255091542ec tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:56.836593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d54ad6d3-7545-47c9-a8ff-2255091542ec tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:56.837597 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d54ad6d3-7545-47c9-a8ff-2255091542ec tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:56.931016 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6e3cea36-296f-4792-b74d-2ff33a328a0e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:56.931656 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6e3cea36-296f-4792-b74d-2ff33a328a0e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:56.938018 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6e3cea36-296f-4792-b74d-2ff33a328a0e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:56.938505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6e3cea36-296f-4792-b74d-2ff33a328a0e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:56.938942 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6e3cea36-296f-4792-b74d-2ff33a328a0e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:56.939642 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6e3cea36-296f-4792-b74d-2ff33a328a0e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:56.940096 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6e3cea36-296f-4792-b74d-2ff33a328a0e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:56.940521 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6e3cea36-296f-4792-b74d-2ff33a328a0e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:56.986583 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d54ad6d3-7545-47c9-a8ff-2255091542ec tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:56.996226 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d54ad6d3-7545-47c9-a8ff-2255091542ec tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:56.997789 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d54ad6d3-7545-47c9-a8ff-2255091542ec tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:56.998922 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d54ad6d3-7545-47c9-a8ff-2255091542ec tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1408 microversion: 2.20 time: 0.176426 Sep 04 16:18:57.013599 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 354/701] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:18:56 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:18:57.103760 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6e3cea36-296f-4792-b74d-2ff33a328a0e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:57.112287 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6e3cea36-296f-4792-b74d-2ff33a328a0e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.185570 Sep 04 16:18:57.112863 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 348/702] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:56 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:18:57.208131 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fe30f5e9-f6c0-48a8-81d5-09f319d72339 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:57.208738 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fe30f5e9-f6c0-48a8-81d5-09f319d72339 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:57.210722 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:18:57.211394 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=26 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:18:57.216221 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe30f5e9-f6c0-48a8-81d5-09f319d72339 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:57.216700 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe30f5e9-f6c0-48a8-81d5-09f319d72339 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:57.217134 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe30f5e9-f6c0-48a8-81d5-09f319d72339 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:57.217846 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe30f5e9-f6c0-48a8-81d5-09f319d72339 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:57.218298 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe30f5e9-f6c0-48a8-81d5-09f319d72339 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:57.218718 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe30f5e9-f6c0-48a8-81d5-09f319d72339 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:57.312920 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b33791cd-55a5-4d3f-8499-2932b30aef7b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:57.313586 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b33791cd-55a5-4d3f-8499-2932b30aef7b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:57.326419 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b33791cd-55a5-4d3f-8499-2932b30aef7b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:57.326917 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b33791cd-55a5-4d3f-8499-2932b30aef7b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:57.327351 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b33791cd-55a5-4d3f-8499-2932b30aef7b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:57.328116 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b33791cd-55a5-4d3f-8499-2932b30aef7b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:57.328565 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b33791cd-55a5-4d3f-8499-2932b30aef7b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:57.328988 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b33791cd-55a5-4d3f-8499-2932b30aef7b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:57.419688 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-fe30f5e9-f6c0-48a8-81d5-09f319d72339 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:57.432256 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fe30f5e9-f6c0-48a8-81d5-09f319d72339 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1358 microversion: 2.1 time: 0.227833 Sep 04 16:18:57.433136 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 355/703] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:57 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:57.487878 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b33791cd-55a5-4d3f-8499-2932b30aef7b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:57.498270 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b33791cd-55a5-4d3f-8499-2932b30aef7b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1366 microversion: 2.1 time: 0.189197 Sep 04 16:18:57.520068 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 349/704] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:57 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:58.025136 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b876076c-7974-4d88-b1aa-9418d6600f89 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:58.025907 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b876076c-7974-4d88-b1aa-9418d6600f89 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:58.032675 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b876076c-7974-4d88-b1aa-9418d6600f89 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:58.033229 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b876076c-7974-4d88-b1aa-9418d6600f89 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:58.033769 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b876076c-7974-4d88-b1aa-9418d6600f89 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:58.034529 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b876076c-7974-4d88-b1aa-9418d6600f89 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:58.035054 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b876076c-7974-4d88-b1aa-9418d6600f89 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:58.035539 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b876076c-7974-4d88-b1aa-9418d6600f89 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:58.138307 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ca4ede85-f529-4c86-a703-2dccd7c6c84b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:58.138916 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ca4ede85-f529-4c86-a703-2dccd7c6c84b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:58.145755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ca4ede85-f529-4c86-a703-2dccd7c6c84b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:58.146241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ca4ede85-f529-4c86-a703-2dccd7c6c84b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:58.146668 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ca4ede85-f529-4c86-a703-2dccd7c6c84b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:58.147362 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ca4ede85-f529-4c86-a703-2dccd7c6c84b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:58.147808 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ca4ede85-f529-4c86-a703-2dccd7c6c84b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:58.148417 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ca4ede85-f529-4c86-a703-2dccd7c6c84b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:58.220530 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b876076c-7974-4d88-b1aa-9418d6600f89 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:58.228854 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b876076c-7974-4d88-b1aa-9418d6600f89 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:58.230331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b876076c-7974-4d88-b1aa-9418d6600f89 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:58.231426 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b876076c-7974-4d88-b1aa-9418d6600f89 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1408 microversion: 2.20 time: 0.210755 Sep 04 16:18:58.232317 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 356/705] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:18:58 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1408 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:18:58.316488 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ca4ede85-f529-4c86-a703-2dccd7c6c84b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:58.326050 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ca4ede85-f529-4c86-a703-2dccd7c6c84b tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.192133 Sep 04 16:18:58.364783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 350/706] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:58 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:58.454772 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eab37033-3ea3-43c5-85a2-163adcb4521f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:58.455404 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eab37033-3ea3-43c5-85a2-163adcb4521f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:58.461693 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eab37033-3ea3-43c5-85a2-163adcb4521f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:58.462183 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eab37033-3ea3-43c5-85a2-163adcb4521f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:58.462624 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eab37033-3ea3-43c5-85a2-163adcb4521f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:58.463317 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eab37033-3ea3-43c5-85a2-163adcb4521f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:58.463772 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eab37033-3ea3-43c5-85a2-163adcb4521f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:58.464202 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eab37033-3ea3-43c5-85a2-163adcb4521f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:58.548697 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4764fdad-aa54-450b-88dc-a783e2a64dd3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:58.549411 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4764fdad-aa54-450b-88dc-a783e2a64dd3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:58.555287 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=14 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:18:58.557967 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4764fdad-aa54-450b-88dc-a783e2a64dd3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:58.558591 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4764fdad-aa54-450b-88dc-a783e2a64dd3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:58.559087 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4764fdad-aa54-450b-88dc-a783e2a64dd3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:58.559920 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4764fdad-aa54-450b-88dc-a783e2a64dd3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:58.560478 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4764fdad-aa54-450b-88dc-a783e2a64dd3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:58.560999 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4764fdad-aa54-450b-88dc-a783e2a64dd3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:58.625503 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-eab37033-3ea3-43c5-85a2-163adcb4521f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:58.638086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eab37033-3ea3-43c5-85a2-163adcb4521f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1358 microversion: 2.1 time: 0.187076 Sep 04 16:18:58.647592 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 357/707] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:58 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:58.734622 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4764fdad-aa54-450b-88dc-a783e2a64dd3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:58.744253 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4764fdad-aa54-450b-88dc-a783e2a64dd3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1366 microversion: 2.1 time: 0.200420 Sep 04 16:18:58.759584 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 351/708] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:58 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:59.256798 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5b62c4af-8313-4a00-8c1a-ea5ee4432506 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:59.257422 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5b62c4af-8313-4a00-8c1a-ea5ee4432506 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:59.264571 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b62c4af-8313-4a00-8c1a-ea5ee4432506 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:59.265039 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b62c4af-8313-4a00-8c1a-ea5ee4432506 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:59.265461 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b62c4af-8313-4a00-8c1a-ea5ee4432506 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:59.266162 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b62c4af-8313-4a00-8c1a-ea5ee4432506 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:59.266610 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b62c4af-8313-4a00-8c1a-ea5ee4432506 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:59.267030 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5b62c4af-8313-4a00-8c1a-ea5ee4432506 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:59.350171 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4ba5d7af-6e17-4e98-837c-c3e011ff6fdd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:59.350918 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4ba5d7af-6e17-4e98-837c-c3e011ff6fdd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:59.358597 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4ba5d7af-6e17-4e98-837c-c3e011ff6fdd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:59.361613 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4ba5d7af-6e17-4e98-837c-c3e011ff6fdd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:59.361613 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4ba5d7af-6e17-4e98-837c-c3e011ff6fdd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:59.361613 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4ba5d7af-6e17-4e98-837c-c3e011ff6fdd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:59.361613 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4ba5d7af-6e17-4e98-837c-c3e011ff6fdd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:59.361995 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4ba5d7af-6e17-4e98-837c-c3e011ff6fdd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:59.432603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5b62c4af-8313-4a00-8c1a-ea5ee4432506 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:59.444007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5b62c4af-8313-4a00-8c1a-ea5ee4432506 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:59.449178 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5b62c4af-8313-4a00-8c1a-ea5ee4432506 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:59.449178 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5b62c4af-8313-4a00-8c1a-ea5ee4432506 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1408 microversion: 2.20 time: 0.195622 Sep 04 16:18:59.455206 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 358/709] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:18:59 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1408 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:18:59.587858 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4ba5d7af-6e17-4e98-837c-c3e011ff6fdd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:59.587858 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4ba5d7af-6e17-4e98-837c-c3e011ff6fdd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.230309 Sep 04 16:18:59.587858 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 352/710] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:59 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:18:59.662062 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-334afacc-7531-4eac-b489-448e6869f448 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:59.662702 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-334afacc-7531-4eac-b489-448e6869f448 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:59.669028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-334afacc-7531-4eac-b489-448e6869f448 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:59.669515 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-334afacc-7531-4eac-b489-448e6869f448 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:59.669982 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-334afacc-7531-4eac-b489-448e6869f448 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:59.670690 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-334afacc-7531-4eac-b489-448e6869f448 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:59.671147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-334afacc-7531-4eac-b489-448e6869f448 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:59.671574 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-334afacc-7531-4eac-b489-448e6869f448 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:59.768097 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0a0464e6-7e06-4ff9-a6a8-d5c3f3d99fe1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:18:59.768712 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0a0464e6-7e06-4ff9-a6a8-d5c3f3d99fe1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:18:59.775164 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0a0464e6-7e06-4ff9-a6a8-d5c3f3d99fe1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:59.775701 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0a0464e6-7e06-4ff9-a6a8-d5c3f3d99fe1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:59.776207 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0a0464e6-7e06-4ff9-a6a8-d5c3f3d99fe1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:59.776902 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0a0464e6-7e06-4ff9-a6a8-d5c3f3d99fe1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:18:59.777360 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0a0464e6-7e06-4ff9-a6a8-d5c3f3d99fe1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:18:59.777808 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0a0464e6-7e06-4ff9-a6a8-d5c3f3d99fe1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:18:59.818214 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-334afacc-7531-4eac-b489-448e6869f448 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:59.828680 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-334afacc-7531-4eac-b489-448e6869f448 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1358 microversion: 2.1 time: 0.170674 Sep 04 16:18:59.829258 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 359/711] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:59 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:18:59.931400 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0a0464e6-7e06-4ff9-a6a8-d5c3f3d99fe1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:18:59.939084 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0a0464e6-7e06-4ff9-a6a8-d5c3f3d99fe1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1366 microversion: 2.1 time: 0.175067 Sep 04 16:18:59.939677 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 353/712] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:18:59 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:19:00.478470 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d6e354a5-9dca-4352-b2ac-f2a45aba08ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:00.479052 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d6e354a5-9dca-4352-b2ac-f2a45aba08ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:00.485550 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6e354a5-9dca-4352-b2ac-f2a45aba08ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:00.486136 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6e354a5-9dca-4352-b2ac-f2a45aba08ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:00.486577 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6e354a5-9dca-4352-b2ac-f2a45aba08ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:00.487240 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6e354a5-9dca-4352-b2ac-f2a45aba08ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:00.487683 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6e354a5-9dca-4352-b2ac-f2a45aba08ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:00.488093 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d6e354a5-9dca-4352-b2ac-f2a45aba08ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:00.603758 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-19e465f1-dd12-467d-8122-709a175aea62 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:00.606445 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-19e465f1-dd12-467d-8122-709a175aea62 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:00.613009 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-19e465f1-dd12-467d-8122-709a175aea62 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:00.613544 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-19e465f1-dd12-467d-8122-709a175aea62 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:00.614034 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-19e465f1-dd12-467d-8122-709a175aea62 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:00.614773 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-19e465f1-dd12-467d-8122-709a175aea62 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:00.615273 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-19e465f1-dd12-467d-8122-709a175aea62 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:00.615796 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-19e465f1-dd12-467d-8122-709a175aea62 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:00.635879 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d6e354a5-9dca-4352-b2ac-f2a45aba08ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:00.646167 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d6e354a5-9dca-4352-b2ac-f2a45aba08ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:00.647640 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d6e354a5-9dca-4352-b2ac-f2a45aba08ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:00.648776 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d6e354a5-9dca-4352-b2ac-f2a45aba08ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1408 microversion: 2.20 time: 0.174301 Sep 04 16:19:00.650210 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 360/713] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:19:00 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:19:00.768962 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-19e465f1-dd12-467d-8122-709a175aea62 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:00.777964 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-19e465f1-dd12-467d-8122-709a175aea62 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.178859 Sep 04 16:19:00.778534 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 354/714] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:00 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:19:00.858950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-195cd45b-f33a-4c9e-b14b-863caecf3f42 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:00.859559 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-195cd45b-f33a-4c9e-b14b-863caecf3f42 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:00.865489 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-195cd45b-f33a-4c9e-b14b-863caecf3f42 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:00.866002 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-195cd45b-f33a-4c9e-b14b-863caecf3f42 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:00.866432 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-195cd45b-f33a-4c9e-b14b-863caecf3f42 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:00.867120 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-195cd45b-f33a-4c9e-b14b-863caecf3f42 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:00.867573 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-195cd45b-f33a-4c9e-b14b-863caecf3f42 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:00.868035 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-195cd45b-f33a-4c9e-b14b-863caecf3f42 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:00.964657 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4eafc709-8cb5-4331-999f-be1fde0c5d3b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:00.965367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4eafc709-8cb5-4331-999f-be1fde0c5d3b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:00.971720 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4eafc709-8cb5-4331-999f-be1fde0c5d3b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:00.972218 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4eafc709-8cb5-4331-999f-be1fde0c5d3b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:00.972655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4eafc709-8cb5-4331-999f-be1fde0c5d3b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:00.973353 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4eafc709-8cb5-4331-999f-be1fde0c5d3b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:00.973836 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4eafc709-8cb5-4331-999f-be1fde0c5d3b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:00.974269 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4eafc709-8cb5-4331-999f-be1fde0c5d3b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:01.000492 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-195cd45b-f33a-4c9e-b14b-863caecf3f42 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:01.009088 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-195cd45b-f33a-4c9e-b14b-863caecf3f42 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1358 microversion: 2.1 time: 0.153483 Sep 04 16:19:01.015418 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 361/715] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:00 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:01.193232 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4eafc709-8cb5-4331-999f-be1fde0c5d3b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:01.205452 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4eafc709-8cb5-4331-999f-be1fde0c5d3b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1366 microversion: 2.1 time: 0.245394 Sep 04 16:19:01.214032 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 355/716] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:00 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:19:01.674475 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c40078e5-f431-43d4-8f7f-bb826489d812 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:01.675075 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c40078e5-f431-43d4-8f7f-bb826489d812 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:01.681522 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c40078e5-f431-43d4-8f7f-bb826489d812 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:01.682014 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c40078e5-f431-43d4-8f7f-bb826489d812 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:01.682441 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c40078e5-f431-43d4-8f7f-bb826489d812 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:01.683116 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c40078e5-f431-43d4-8f7f-bb826489d812 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:01.683601 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c40078e5-f431-43d4-8f7f-bb826489d812 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:01.684011 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c40078e5-f431-43d4-8f7f-bb826489d812 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:01.802479 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cc18ea37-920b-4637-98d4-e97a8f28dff8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:01.803896 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cc18ea37-920b-4637-98d4-e97a8f28dff8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:01.810224 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cc18ea37-920b-4637-98d4-e97a8f28dff8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:01.810714 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cc18ea37-920b-4637-98d4-e97a8f28dff8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:01.811200 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cc18ea37-920b-4637-98d4-e97a8f28dff8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:01.811883 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cc18ea37-920b-4637-98d4-e97a8f28dff8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:01.812336 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cc18ea37-920b-4637-98d4-e97a8f28dff8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:01.812757 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cc18ea37-920b-4637-98d4-e97a8f28dff8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:02.374575 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c40078e5-f431-43d4-8f7f-bb826489d812 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:02.384704 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c40078e5-f431-43d4-8f7f-bb826489d812 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:02.386318 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c40078e5-f431-43d4-8f7f-bb826489d812 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:02.387696 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c40078e5-f431-43d4-8f7f-bb826489d812 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1408 microversion: 2.20 time: 0.717471 Sep 04 16:19:02.394099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 362/717] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:19:01 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1408 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:19:02.394099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f29149fb-4c76-49c8-93d7-05164d8a727a tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:02.394715 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f29149fb-4c76-49c8-93d7-05164d8a727a tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:02.401830 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29149fb-4c76-49c8-93d7-05164d8a727a tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:02.402379 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29149fb-4c76-49c8-93d7-05164d8a727a tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:02.403037 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29149fb-4c76-49c8-93d7-05164d8a727a tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:02.403867 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29149fb-4c76-49c8-93d7-05164d8a727a tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:02.404402 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29149fb-4c76-49c8-93d7-05164d8a727a tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:02.404886 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f29149fb-4c76-49c8-93d7-05164d8a727a tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:02.409391 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:19:02.575476 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-cc18ea37-920b-4637-98d4-e97a8f28dff8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:02.579238 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:19:02.584695 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cc18ea37-920b-4637-98d4-e97a8f28dff8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1733 microversion: 2.1 time: 0.787059 Sep 04 16:19:02.591384 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 356/718] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:01 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1733 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:19:02.597805 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-71e3388d-43cd-42b4-b989-f90c88622342 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:02.597805 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-71e3388d-43cd-42b4-b989-f90c88622342 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:02.610415 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71e3388d-43cd-42b4-b989-f90c88622342 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:02.611011 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71e3388d-43cd-42b4-b989-f90c88622342 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:02.611461 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71e3388d-43cd-42b4-b989-f90c88622342 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:02.612180 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71e3388d-43cd-42b4-b989-f90c88622342 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:02.612633 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71e3388d-43cd-42b4-b989-f90c88622342 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:02.613064 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71e3388d-43cd-42b4-b989-f90c88622342 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:02.920659 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f29149fb-4c76-49c8-93d7-05164d8a727a tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:02.929219 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f29149fb-4c76-49c8-93d7-05164d8a727a tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1358 microversion: 2.1 time: 0.539790 Sep 04 16:19:02.931851 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 363/719] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:02 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1358 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:02.993759 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-71e3388d-43cd-42b4-b989-f90c88622342 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:03.001684 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-71e3388d-43cd-42b4-b989-f90c88622342 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1366 microversion: 2.1 time: 0.409266 Sep 04 16:19:03.002264 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 357/720] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:02 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1366 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:03.031255 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-c7c5d2af-3f2c-4e2f-8074-016dc57cb40e req-cc7e22bb-8e4c-408d-9845-76979a8e0534 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1c47389-a373-46bc-8601-5a0038fa00c6", "tag": "156cd70b-43a3-4b2d-899b-983cd2ad0541"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:19:03.041489 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c7c5d2af-3f2c-4e2f-8074-016dc57cb40e req-cc7e22bb-8e4c-408d-9845-76979a8e0534 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:03.045747 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c7c5d2af-3f2c-4e2f-8074-016dc57cb40e req-cc7e22bb-8e4c-408d-9845-76979a8e0534 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:03.045747 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-c7c5d2af-3f2c-4e2f-8074-016dc57cb40e req-cc7e22bb-8e4c-408d-9845-76979a8e0534 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:03.053871 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-c7c5d2af-3f2c-4e2f-8074-016dc57cb40e req-cc7e22bb-8e4c-408d-9845-76979a8e0534 service nova] Creating event network-changed:156cd70b-43a3-4b2d-899b-983cd2ad0541 for instance b1c47389-a373-46bc-8601-5a0038fa00c6 on hv-cinder-85236 Sep 04 16:19:03.061446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-c7c5d2af-3f2c-4e2f-8074-016dc57cb40e req-cc7e22bb-8e4c-408d-9845-76979a8e0534 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033558 Sep 04 16:19:03.062336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 364/721] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:19:03.413749 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c614c4b1-f256-4e2a-89cd-f2a82be0538a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:03.414356 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c614c4b1-f256-4e2a-89cd-f2a82be0538a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:03.420575 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c614c4b1-f256-4e2a-89cd-f2a82be0538a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:03.421063 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c614c4b1-f256-4e2a-89cd-f2a82be0538a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:03.421493 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c614c4b1-f256-4e2a-89cd-f2a82be0538a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:03.422194 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c614c4b1-f256-4e2a-89cd-f2a82be0538a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:03.422642 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c614c4b1-f256-4e2a-89cd-f2a82be0538a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:03.423059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c614c4b1-f256-4e2a-89cd-f2a82be0538a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:03.562826 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c614c4b1-f256-4e2a-89cd-f2a82be0538a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:03.572011 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c614c4b1-f256-4e2a-89cd-f2a82be0538a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:03.574365 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c614c4b1-f256-4e2a-89cd-f2a82be0538a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:03.575585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c614c4b1-f256-4e2a-89cd-f2a82be0538a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1408 microversion: 2.20 time: 0.165875 Sep 04 16:19:03.576145 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 358/722] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:19:03 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:19:03.609342 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4d55c3da-6335-4b44-ae88-12a73328a1fe tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:03.609985 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4d55c3da-6335-4b44-ae88-12a73328a1fe tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:03.616084 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d55c3da-6335-4b44-ae88-12a73328a1fe tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:03.616560 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d55c3da-6335-4b44-ae88-12a73328a1fe tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:03.616992 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d55c3da-6335-4b44-ae88-12a73328a1fe tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:03.617695 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d55c3da-6335-4b44-ae88-12a73328a1fe tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:03.618834 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d55c3da-6335-4b44-ae88-12a73328a1fe tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:03.622754 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4d55c3da-6335-4b44-ae88-12a73328a1fe tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:03.761613 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4d55c3da-6335-4b44-ae88-12a73328a1fe tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:03.772193 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4d55c3da-6335-4b44-ae88-12a73328a1fe tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1713 microversion: 2.1 time: 0.167113 Sep 04 16:19:03.773904 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 365/723] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:03 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1713 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:03.840146 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ed4b06ed-c0af-4996-b6d0-eb40ae1a6bba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:03.840633 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ed4b06ed-c0af-4996-b6d0-eb40ae1a6bba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:03.847070 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ed4b06ed-c0af-4996-b6d0-eb40ae1a6bba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:03.847546 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ed4b06ed-c0af-4996-b6d0-eb40ae1a6bba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:03.847976 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ed4b06ed-c0af-4996-b6d0-eb40ae1a6bba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:03.848657 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ed4b06ed-c0af-4996-b6d0-eb40ae1a6bba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:03.849099 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ed4b06ed-c0af-4996-b6d0-eb40ae1a6bba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:03.849514 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ed4b06ed-c0af-4996-b6d0-eb40ae1a6bba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:03.931738 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-ed4b06ed-c0af-4996-b6d0-eb40ae1a6bba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] HTTP exception thrown: Cannot 'detach_volume' instance 0188e4a8-e601-43da-b389-7e0a8410ae8d while it is in vm_state rescued Sep 04 16:19:03.933398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ed4b06ed-c0af-4996-b6d0-eb40ae1a6bba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Request method failure captured: Sep 04 16:19:03.933398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: DELETE /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d/os-volume_attachments/80716f97-c736-4682-bf4f-b71c2ee354bf HTTP/1.1 Sep 04 16:19:03.933398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:19:03.933398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:19:03.933398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:19:03.933398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:19:03.933398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:19:03.933398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:19:03.933398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:19:03.933398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:19:03.933398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFM7AQu8qea0BFPhZJJD1SjpMjCb9OT3yqcZNamIbdv_2tiOBslm23HUMyFLRuEja9zOxHSb7HCyTIWbzZ5oqcjUZcQ0rElKr7qovko9hAD8HBN652TVbu8E6ygcWWlMFsAALAQQiHxyfrlUQj8PuQ9eIFVlDfwklsO4cKSYRuTyg9y4 Sep 04 16:19:03.933398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:19:03.933398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:19:03.933398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:19:03.933398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:19:03.933398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:19:03.933398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:19:03.933398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: cb043a0ecad3466bbd5a5874126d2810 Sep 04 16:19:03.933398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1718450479 Sep 04 16:19:03.933398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:19:03.933398 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:19:03.935016 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cb043a0ecad3466bbd5a5874126d2810"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb043a0ecad3466bbd5a5874126d2810"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cb043a0ecad3466bbd5a5874126d2810", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb043a0ecad3466bbd5a5874126d2810"}]}] Sep 04 16:19:03.935016 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1718450479 Sep 04 16:19:03.935016 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: cb043a0ecad3466bbd5a5874126d2810 Sep 04 16:19:03.935016 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1718450479 Sep 04 16:19:03.935016 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-ServerRescueNegativeTestJSON-1718450479-project Sep 04 16:19:03.935016 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:19:03.935016 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:19:03.935016 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: a9d55c52717546b09d93d956a29f49a9 Sep 04 16:19:03.935016 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1718450479-project Sep 04 16:19:03.935016 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: > Sep 04 16:19:03.935016 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Cannot 'detach_volume' instance 0188e4a8-e601-43da-b389-7e0a8410ae8d while it is in vm_state rescued Sep 04 16:19:03.935783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'server_id': '0188e4a8-e601-43da-b389-7e0a8410ae8d', 'id': '80716f97-c736-4682-bf4f-b71c2ee354bf'} Sep 04 16:19:03.935783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:19:03.935783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:19:03.935783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 04 16:19:03.935783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 04 16:19:03.935783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 04 16:19:03.935783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 04 16:19:03.935783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 04 16:19:03.935783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 04 16:19:03.935783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0188e4a8-e601-43da-b389-7e0a8410ae8d in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 04 16:19:03.935783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:19:03.935783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:19:03.935783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:19:03.935783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:19:03.935783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:19:03.935783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:19:03.935783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:19:03.935783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:19:03.935783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:19:03.935783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:19:03.937039 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 04 16:19:03.937039 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 04 16:19:03.937039 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 04 16:19:03.937039 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 04 16:19:03.937039 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0188e4a8-e601-43da-b389-7e0a8410ae8d while it is in vm_state rescued Sep 04 16:19:03.937039 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:19:03.937039 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:19:03.937039 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:19:03.937039 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:19:03.937039 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:19:03.937039 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:19:03.937039 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:19:03.937039 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:19:03.937039 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0188e4a8-e601-43da-b389-7e0a8410ae8d while it is in vm_state rescued Sep 04 16:19:03.937039 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:19:03.937039 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ed4b06ed-c0af-4996-b6d0-eb40ae1a6bba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Returning 409 to user: Cannot 'detach_volume' instance 0188e4a8-e601-43da-b389-7e0a8410ae8d while it is in vm_state rescued {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:19:03.938055 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ed4b06ed-c0af-4996-b6d0-eb40ae1a6bba tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d/os-volume_attachments/80716f97-c736-4682-bf4f-b71c2ee354bf" status: 409 len: 152 microversion: 2.1 time: 0.099286 Sep 04 16:19:03.938055 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 359/724] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Sep 4 16:19:03 2022] DELETE /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d/os-volume_attachments/80716f97-c736-4682-bf4f-b71c2ee354bf => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 04 16:19:03.943596 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ba1e835c-52e8-4489-9cb3-b53ddce9c05c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:19:03.944122 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ba1e835c-52e8-4489-9cb3-b53ddce9c05c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:03.951029 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba1e835c-52e8-4489-9cb3-b53ddce9c05c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:03.951515 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba1e835c-52e8-4489-9cb3-b53ddce9c05c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:03.951828 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-342a51c7-aa15-422a-93ac-531b4169aac8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:03.951947 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba1e835c-52e8-4489-9cb3-b53ddce9c05c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:03.952495 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-342a51c7-aa15-422a-93ac-531b4169aac8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:03.952669 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba1e835c-52e8-4489-9cb3-b53ddce9c05c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:03.953056 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba1e835c-52e8-4489-9cb3-b53ddce9c05c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:03.953475 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ba1e835c-52e8-4489-9cb3-b53ddce9c05c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:03.959099 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-342a51c7-aa15-422a-93ac-531b4169aac8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:03.959572 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-342a51c7-aa15-422a-93ac-531b4169aac8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:03.960005 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-342a51c7-aa15-422a-93ac-531b4169aac8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:03.960682 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-342a51c7-aa15-422a-93ac-531b4169aac8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:03.961128 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-342a51c7-aa15-422a-93ac-531b4169aac8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:03.961546 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-342a51c7-aa15-422a-93ac-531b4169aac8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:04.091856 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-342a51c7-aa15-422a-93ac-531b4169aac8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:04.099514 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-342a51c7-aa15-422a-93ac-531b4169aac8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1358 microversion: 2.1 time: 0.151362 Sep 04 16:19:04.103479 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 360/725] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:03 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:19:04.105261 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1f5d6797-8d47-4002-b094-30189b0b41f0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:04.105945 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1f5d6797-8d47-4002-b094-30189b0b41f0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:04.112446 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1f5d6797-8d47-4002-b094-30189b0b41f0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:04.112923 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1f5d6797-8d47-4002-b094-30189b0b41f0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:04.113494 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1f5d6797-8d47-4002-b094-30189b0b41f0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:04.114214 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1f5d6797-8d47-4002-b094-30189b0b41f0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:04.114663 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1f5d6797-8d47-4002-b094-30189b0b41f0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:04.115326 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1f5d6797-8d47-4002-b094-30189b0b41f0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:04.175115 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ba1e835c-52e8-4489-9cb3-b53ddce9c05c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "POST /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d/action" status: 202 len: 0 microversion: 2.1 time: 0.235021 Sep 04 16:19:04.175941 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 366/726] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Sep 4 16:19:03 2022] POST /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:19:04.184440 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f455e744-726e-434e-8e48-8024c058230d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:04.185703 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f455e744-726e-434e-8e48-8024c058230d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:04.191383 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f455e744-726e-434e-8e48-8024c058230d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:04.191868 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f455e744-726e-434e-8e48-8024c058230d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:04.192310 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f455e744-726e-434e-8e48-8024c058230d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:04.193005 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f455e744-726e-434e-8e48-8024c058230d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:04.193463 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f455e744-726e-434e-8e48-8024c058230d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:04.193912 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f455e744-726e-434e-8e48-8024c058230d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:04.271301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1f5d6797-8d47-4002-b094-30189b0b41f0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:04.279727 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1f5d6797-8d47-4002-b094-30189b0b41f0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1366 microversion: 2.1 time: 0.178591 Sep 04 16:19:04.280303 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 361/727] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:04 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:04.336412 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f455e744-726e-434e-8e48-8024c058230d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:04.345124 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f455e744-726e-434e-8e48-8024c058230d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1721 microversion: 2.1 time: 0.164820 Sep 04 16:19:04.345734 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 367/728] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:04 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:19:04.605034 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9a12037f-c2d1-4daf-b431-335d3e9dd9eb tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:04.605667 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9a12037f-c2d1-4daf-b431-335d3e9dd9eb tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:04.611594 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a12037f-c2d1-4daf-b431-335d3e9dd9eb tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:04.612074 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a12037f-c2d1-4daf-b431-335d3e9dd9eb tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:04.612504 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a12037f-c2d1-4daf-b431-335d3e9dd9eb tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:04.613183 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a12037f-c2d1-4daf-b431-335d3e9dd9eb tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:04.613656 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a12037f-c2d1-4daf-b431-335d3e9dd9eb tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:04.614085 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a12037f-c2d1-4daf-b431-335d3e9dd9eb tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:04.755808 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9a12037f-c2d1-4daf-b431-335d3e9dd9eb tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:04.764118 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9a12037f-c2d1-4daf-b431-335d3e9dd9eb tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:04.765596 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9a12037f-c2d1-4daf-b431-335d3e9dd9eb tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:04.766712 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9a12037f-c2d1-4daf-b431-335d3e9dd9eb tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1408 microversion: 2.20 time: 0.166303 Sep 04 16:19:04.767268 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 362/729] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:19:04 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:19:05.123320 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0ca517e0-cd7f-4461-9ada-fea12b6f8cac tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:05.124135 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0ca517e0-cd7f-4461-9ada-fea12b6f8cac tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:05.131120 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ca517e0-cd7f-4461-9ada-fea12b6f8cac tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:05.131685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ca517e0-cd7f-4461-9ada-fea12b6f8cac tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:05.132180 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ca517e0-cd7f-4461-9ada-fea12b6f8cac tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:05.132948 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ca517e0-cd7f-4461-9ada-fea12b6f8cac tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:05.133486 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ca517e0-cd7f-4461-9ada-fea12b6f8cac tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:05.134077 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ca517e0-cd7f-4461-9ada-fea12b6f8cac tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:05.303694 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0babfcb2-3877-4d74-8750-32a0b0fc1d06 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:05.304492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0babfcb2-3877-4d74-8750-32a0b0fc1d06 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:05.311306 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0babfcb2-3877-4d74-8750-32a0b0fc1d06 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:05.311793 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0babfcb2-3877-4d74-8750-32a0b0fc1d06 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:05.312224 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0babfcb2-3877-4d74-8750-32a0b0fc1d06 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:05.312920 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0babfcb2-3877-4d74-8750-32a0b0fc1d06 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:05.313372 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0babfcb2-3877-4d74-8750-32a0b0fc1d06 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:05.313823 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0babfcb2-3877-4d74-8750-32a0b0fc1d06 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:05.558851 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0ca517e0-cd7f-4461-9ada-fea12b6f8cac tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:05.566583 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0ca517e0-cd7f-4461-9ada-fea12b6f8cac tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1358 microversion: 2.1 time: 0.447191 Sep 04 16:19:05.567168 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 368/730] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:05 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1358 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:19:05.572332 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f5276031-8db1-48f5-919e-4f47b1f9a753 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:05.573093 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f5276031-8db1-48f5-919e-4f47b1f9a753 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:05.578833 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5276031-8db1-48f5-919e-4f47b1f9a753 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:05.579319 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5276031-8db1-48f5-919e-4f47b1f9a753 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:05.579800 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5276031-8db1-48f5-919e-4f47b1f9a753 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:05.580496 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5276031-8db1-48f5-919e-4f47b1f9a753 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:05.581115 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5276031-8db1-48f5-919e-4f47b1f9a753 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:05.581850 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f5276031-8db1-48f5-919e-4f47b1f9a753 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:06.063055 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0babfcb2-3877-4d74-8750-32a0b0fc1d06 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:06.070957 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0babfcb2-3877-4d74-8750-32a0b0fc1d06 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1366 microversion: 2.1 time: 0.771222 Sep 04 16:19:06.072440 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 363/731] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:05 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1366 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:19:06.090359 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-faf16b82-890c-42fa-9191-8cda38541997 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:06.090969 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-faf16b82-890c-42fa-9191-8cda38541997 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:06.096780 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-faf16b82-890c-42fa-9191-8cda38541997 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:06.097254 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-faf16b82-890c-42fa-9191-8cda38541997 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:06.097711 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-faf16b82-890c-42fa-9191-8cda38541997 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:06.098395 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-faf16b82-890c-42fa-9191-8cda38541997 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:06.098839 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-faf16b82-890c-42fa-9191-8cda38541997 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:06.099267 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-faf16b82-890c-42fa-9191-8cda38541997 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:06.284715 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f5276031-8db1-48f5-919e-4f47b1f9a753 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:06.293021 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f5276031-8db1-48f5-919e-4f47b1f9a753 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1721 microversion: 2.1 time: 0.724874 Sep 04 16:19:06.293615 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 369/732] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:05 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1721 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:06.491514 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-faf16b82-890c-42fa-9191-8cda38541997 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:06.503240 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-faf16b82-890c-42fa-9191-8cda38541997 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:06.504758 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-faf16b82-890c-42fa-9191-8cda38541997 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:06.505937 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-faf16b82-890c-42fa-9191-8cda38541997 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1408 microversion: 2.20 time: 0.432547 Sep 04 16:19:06.506503 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 364/733] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:19:06 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1408 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:19:06.591046 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5e55636b-e14a-4e9f-afb6-fdab0d5fcfb2 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:06.591680 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5e55636b-e14a-4e9f-afb6-fdab0d5fcfb2 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:06.598287 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e55636b-e14a-4e9f-afb6-fdab0d5fcfb2 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:06.598780 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e55636b-e14a-4e9f-afb6-fdab0d5fcfb2 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:06.599218 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e55636b-e14a-4e9f-afb6-fdab0d5fcfb2 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:06.599927 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e55636b-e14a-4e9f-afb6-fdab0d5fcfb2 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:06.600400 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e55636b-e14a-4e9f-afb6-fdab0d5fcfb2 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:06.600824 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e55636b-e14a-4e9f-afb6-fdab0d5fcfb2 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:06.736571 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5e55636b-e14a-4e9f-afb6-fdab0d5fcfb2 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:06.744338 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5e55636b-e14a-4e9f-afb6-fdab0d5fcfb2 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1358 microversion: 2.1 time: 0.158047 Sep 04 16:19:06.744915 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 370/734] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:06 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:07.096344 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e9f47b3e-cfe1-48c6-a977-1e9a2c5410fd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:07.096953 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e9f47b3e-cfe1-48c6-a977-1e9a2c5410fd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:07.103826 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e9f47b3e-cfe1-48c6-a977-1e9a2c5410fd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:07.104300 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e9f47b3e-cfe1-48c6-a977-1e9a2c5410fd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:07.104734 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e9f47b3e-cfe1-48c6-a977-1e9a2c5410fd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:07.105419 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e9f47b3e-cfe1-48c6-a977-1e9a2c5410fd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:07.105897 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e9f47b3e-cfe1-48c6-a977-1e9a2c5410fd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:07.106415 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e9f47b3e-cfe1-48c6-a977-1e9a2c5410fd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:07.236446 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e9f47b3e-cfe1-48c6-a977-1e9a2c5410fd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:07.245903 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e9f47b3e-cfe1-48c6-a977-1e9a2c5410fd tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1366 microversion: 2.1 time: 0.153398 Sep 04 16:19:07.246926 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 365/735] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:07 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:07.316378 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-db97bdd8-e35b-4f76-987b-8372d5b15a50 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:07.316988 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-db97bdd8-e35b-4f76-987b-8372d5b15a50 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:07.324241 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db97bdd8-e35b-4f76-987b-8372d5b15a50 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:07.324725 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db97bdd8-e35b-4f76-987b-8372d5b15a50 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:07.325160 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db97bdd8-e35b-4f76-987b-8372d5b15a50 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:07.325889 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db97bdd8-e35b-4f76-987b-8372d5b15a50 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:07.326340 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db97bdd8-e35b-4f76-987b-8372d5b15a50 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:07.326762 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-db97bdd8-e35b-4f76-987b-8372d5b15a50 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:07.454164 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-db97bdd8-e35b-4f76-987b-8372d5b15a50 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:07.463170 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-db97bdd8-e35b-4f76-987b-8372d5b15a50 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1721 microversion: 2.1 time: 0.150750 Sep 04 16:19:07.463777 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 371/736] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:07 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:07.531402 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-421f65a7-8e3f-458f-9d92-a789a640852d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:07.532005 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-421f65a7-8e3f-458f-9d92-a789a640852d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:07.538549 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-421f65a7-8e3f-458f-9d92-a789a640852d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:07.539024 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-421f65a7-8e3f-458f-9d92-a789a640852d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:07.539450 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-421f65a7-8e3f-458f-9d92-a789a640852d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:07.540264 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-421f65a7-8e3f-458f-9d92-a789a640852d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:07.540764 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-421f65a7-8e3f-458f-9d92-a789a640852d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:07.541174 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-421f65a7-8e3f-458f-9d92-a789a640852d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:07.675698 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-421f65a7-8e3f-458f-9d92-a789a640852d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:07.684253 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-421f65a7-8e3f-458f-9d92-a789a640852d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:07.685735 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-421f65a7-8e3f-458f-9d92-a789a640852d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:07.686845 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-421f65a7-8e3f-458f-9d92-a789a640852d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1408 microversion: 2.20 time: 0.159490 Sep 04 16:19:07.693357 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 366/737] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:19:07 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:19:07.767544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ab27c8c4-9466-4a43-8422-081d2db2b19b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:07.768153 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ab27c8c4-9466-4a43-8422-081d2db2b19b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:07.774683 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab27c8c4-9466-4a43-8422-081d2db2b19b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:07.775162 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab27c8c4-9466-4a43-8422-081d2db2b19b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:07.775589 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab27c8c4-9466-4a43-8422-081d2db2b19b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:07.776273 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab27c8c4-9466-4a43-8422-081d2db2b19b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:07.776720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab27c8c4-9466-4a43-8422-081d2db2b19b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:07.777135 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ab27c8c4-9466-4a43-8422-081d2db2b19b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:07.910595 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ab27c8c4-9466-4a43-8422-081d2db2b19b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:07.919029 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ab27c8c4-9466-4a43-8422-081d2db2b19b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1358 microversion: 2.1 time: 0.155435 Sep 04 16:19:07.919725 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 372/738] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:07 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:08.270598 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9b30e6df-9440-4696-9bff-146adbb60a1e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:08.271132 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9b30e6df-9440-4696-9bff-146adbb60a1e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:08.277744 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9b30e6df-9440-4696-9bff-146adbb60a1e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:08.278222 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9b30e6df-9440-4696-9bff-146adbb60a1e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:08.278650 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9b30e6df-9440-4696-9bff-146adbb60a1e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:08.279333 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9b30e6df-9440-4696-9bff-146adbb60a1e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:08.279784 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9b30e6df-9440-4696-9bff-146adbb60a1e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:08.280207 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9b30e6df-9440-4696-9bff-146adbb60a1e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:08.413782 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9b30e6df-9440-4696-9bff-146adbb60a1e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:08.421955 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9b30e6df-9440-4696-9bff-146adbb60a1e tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1366 microversion: 2.1 time: 0.155552 Sep 04 16:19:08.422523 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 367/739] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:08 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:08.487692 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-227b5298-c394-4ba2-9088-14c44ff7bfb6 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:08.488426 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-227b5298-c394-4ba2-9088-14c44ff7bfb6 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:08.501612 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-227b5298-c394-4ba2-9088-14c44ff7bfb6 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:08.502104 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-227b5298-c394-4ba2-9088-14c44ff7bfb6 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:08.502543 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-227b5298-c394-4ba2-9088-14c44ff7bfb6 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:08.503249 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-227b5298-c394-4ba2-9088-14c44ff7bfb6 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:08.503710 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-227b5298-c394-4ba2-9088-14c44ff7bfb6 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:08.504137 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-227b5298-c394-4ba2-9088-14c44ff7bfb6 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:08.638966 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-227b5298-c394-4ba2-9088-14c44ff7bfb6 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:08.650780 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-227b5298-c394-4ba2-9088-14c44ff7bfb6 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1721 microversion: 2.1 time: 0.167032 Sep 04 16:19:08.651476 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 373/740] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:08 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:08.712894 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b1639e89-dc0e-4eb9-90c9-15a7cbcdae41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:08.713515 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b1639e89-dc0e-4eb9-90c9-15a7cbcdae41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:08.720020 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b1639e89-dc0e-4eb9-90c9-15a7cbcdae41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:08.720505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b1639e89-dc0e-4eb9-90c9-15a7cbcdae41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:08.720945 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b1639e89-dc0e-4eb9-90c9-15a7cbcdae41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:08.721666 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b1639e89-dc0e-4eb9-90c9-15a7cbcdae41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:08.722124 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b1639e89-dc0e-4eb9-90c9-15a7cbcdae41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:08.722552 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b1639e89-dc0e-4eb9-90c9-15a7cbcdae41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:08.852107 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b1639e89-dc0e-4eb9-90c9-15a7cbcdae41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:08.861204 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b1639e89-dc0e-4eb9-90c9-15a7cbcdae41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:08.862698 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b1639e89-dc0e-4eb9-90c9-15a7cbcdae41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:08.863813 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b1639e89-dc0e-4eb9-90c9-15a7cbcdae41 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1408 microversion: 2.20 time: 0.155538 Sep 04 16:19:08.864373 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 368/741] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:19:08 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:19:08.942765 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6cf5f245-f400-46e1-aa2c-a055bd203fd8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:08.943363 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6cf5f245-f400-46e1-aa2c-a055bd203fd8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:08.949953 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6cf5f245-f400-46e1-aa2c-a055bd203fd8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:08.950427 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6cf5f245-f400-46e1-aa2c-a055bd203fd8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:08.950853 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6cf5f245-f400-46e1-aa2c-a055bd203fd8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:08.951529 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6cf5f245-f400-46e1-aa2c-a055bd203fd8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:08.951972 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6cf5f245-f400-46e1-aa2c-a055bd203fd8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:08.952385 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6cf5f245-f400-46e1-aa2c-a055bd203fd8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:09.082960 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-6cf5f245-f400-46e1-aa2c-a055bd203fd8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:09.091413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6cf5f245-f400-46e1-aa2c-a055bd203fd8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1358 microversion: 2.1 time: 0.152490 Sep 04 16:19:09.094112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 374/742] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:08 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:09.445213 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d0770aec-6ee5-4431-b1bd-cf7418d7dda3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:09.445839 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d0770aec-6ee5-4431-b1bd-cf7418d7dda3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:09.452293 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d0770aec-6ee5-4431-b1bd-cf7418d7dda3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:09.452770 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d0770aec-6ee5-4431-b1bd-cf7418d7dda3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:09.453197 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d0770aec-6ee5-4431-b1bd-cf7418d7dda3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:09.454024 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d0770aec-6ee5-4431-b1bd-cf7418d7dda3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:09.454422 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d0770aec-6ee5-4431-b1bd-cf7418d7dda3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:09.459452 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d0770aec-6ee5-4431-b1bd-cf7418d7dda3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:09.588202 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d0770aec-6ee5-4431-b1bd-cf7418d7dda3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:09.595769 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d0770aec-6ee5-4431-b1bd-cf7418d7dda3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1366 microversion: 2.1 time: 0.154469 Sep 04 16:19:09.597202 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 369/743] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:09 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:09.674937 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8a303bd9-a3b4-4e89-bb95-6e1e5e3f40e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:09.675544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8a303bd9-a3b4-4e89-bb95-6e1e5e3f40e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:09.682789 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a303bd9-a3b4-4e89-bb95-6e1e5e3f40e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:09.683264 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a303bd9-a3b4-4e89-bb95-6e1e5e3f40e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:09.683700 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a303bd9-a3b4-4e89-bb95-6e1e5e3f40e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:09.684387 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a303bd9-a3b4-4e89-bb95-6e1e5e3f40e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:09.684840 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a303bd9-a3b4-4e89-bb95-6e1e5e3f40e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:09.685260 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8a303bd9-a3b4-4e89-bb95-6e1e5e3f40e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:09.819892 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-8a303bd9-a3b4-4e89-bb95-6e1e5e3f40e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:09.828142 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8a303bd9-a3b4-4e89-bb95-6e1e5e3f40e2 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1727 microversion: 2.1 time: 0.157209 Sep 04 16:19:09.828712 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 375/744] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:09 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:09.853906 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0ca58949-42be-4cc1-af83-34bc9388838a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:09.854695 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0ca58949-42be-4cc1-af83-34bc9388838a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:09.860943 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ca58949-42be-4cc1-af83-34bc9388838a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:09.861478 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ca58949-42be-4cc1-af83-34bc9388838a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:09.861950 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ca58949-42be-4cc1-af83-34bc9388838a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:09.862647 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ca58949-42be-4cc1-af83-34bc9388838a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:09.863102 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ca58949-42be-4cc1-af83-34bc9388838a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:09.863525 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0ca58949-42be-4cc1-af83-34bc9388838a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:09.889891 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b3e382c6-87a5-49cb-847e-324c2649aa4e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:09.890492 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b3e382c6-87a5-49cb-847e-324c2649aa4e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:09.897035 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3e382c6-87a5-49cb-847e-324c2649aa4e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:09.897523 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3e382c6-87a5-49cb-847e-324c2649aa4e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:09.898045 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3e382c6-87a5-49cb-847e-324c2649aa4e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:09.898728 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3e382c6-87a5-49cb-847e-324c2649aa4e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:09.899189 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3e382c6-87a5-49cb-847e-324c2649aa4e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:09.899766 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b3e382c6-87a5-49cb-847e-324c2649aa4e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:09.972455 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0ca58949-42be-4cc1-af83-34bc9388838a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121819 Sep 04 16:19:09.972455 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 370/745] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Sep 4 16:19:09 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d/os-interface => generated 284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:19:10.053346 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b3e382c6-87a5-49cb-847e-324c2649aa4e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:10.061642 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b3e382c6-87a5-49cb-847e-324c2649aa4e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:10.063774 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b3e382c6-87a5-49cb-847e-324c2649aa4e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:10.065198 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b3e382c6-87a5-49cb-847e-324c2649aa4e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1408 microversion: 2.20 time: 0.179130 Sep 04 16:19:10.066291 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 376/746] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:19:09 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:19:10.115611 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9a8aac6b-f04b-4808-a714-008dd6064d9c tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:10.116442 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9a8aac6b-f04b-4808-a714-008dd6064d9c tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:10.123611 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a8aac6b-f04b-4808-a714-008dd6064d9c tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:10.124391 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a8aac6b-f04b-4808-a714-008dd6064d9c tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:10.124981 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a8aac6b-f04b-4808-a714-008dd6064d9c tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:10.125874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a8aac6b-f04b-4808-a714-008dd6064d9c tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:10.126476 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a8aac6b-f04b-4808-a714-008dd6064d9c tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:10.127112 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9a8aac6b-f04b-4808-a714-008dd6064d9c tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:10.193309 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-433b0ea7-d31d-426d-ad2b-a17571241110 req-93a6f3bb-0e27-4c72-9416-43a912ca4f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e5636f2-5f2f-45ca-af8a-d998079502df", "name": "network-vif-plugged", "status": "completed", "tag": "5109bc3e-5bc8-407d-b0e7-4d3d700d2044"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:19:10.204028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-433b0ea7-d31d-426d-ad2b-a17571241110 req-93a6f3bb-0e27-4c72-9416-43a912ca4f1f service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:10.204513 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-433b0ea7-d31d-426d-ad2b-a17571241110 req-93a6f3bb-0e27-4c72-9416-43a912ca4f1f service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:10.204939 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-433b0ea7-d31d-426d-ad2b-a17571241110 req-93a6f3bb-0e27-4c72-9416-43a912ca4f1f service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:10.228274 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-433b0ea7-d31d-426d-ad2b-a17571241110 req-93a6f3bb-0e27-4c72-9416-43a912ca4f1f service nova] Creating event network-vif-plugged:5109bc3e-5bc8-407d-b0e7-4d3d700d2044 for instance 9e5636f2-5f2f-45ca-af8a-d998079502df on hv-cinder-85236 Sep 04 16:19:10.238627 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-433b0ea7-d31d-426d-ad2b-a17571241110 req-93a6f3bb-0e27-4c72-9416-43a912ca4f1f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048210 Sep 04 16:19:10.239942 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 377/747] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:19:10.300097 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9a8aac6b-f04b-4808-a714-008dd6064d9c tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:10.310755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9a8aac6b-f04b-4808-a714-008dd6064d9c tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1358 microversion: 2.1 time: 0.198809 Sep 04 16:19:10.327631 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 371/748] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:10 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:10.619930 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1bffa011-ae33-49a7-be22-be8c10ea6507 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:10.620762 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1bffa011-ae33-49a7-be22-be8c10ea6507 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:10.627822 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1bffa011-ae33-49a7-be22-be8c10ea6507 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:10.628595 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1bffa011-ae33-49a7-be22-be8c10ea6507 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:10.629099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1bffa011-ae33-49a7-be22-be8c10ea6507 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:10.629938 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1bffa011-ae33-49a7-be22-be8c10ea6507 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:10.630465 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1bffa011-ae33-49a7-be22-be8c10ea6507 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:10.630952 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1bffa011-ae33-49a7-be22-be8c10ea6507 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:10.844498 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1bffa011-ae33-49a7-be22-be8c10ea6507 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:10.857217 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1bffa011-ae33-49a7-be22-be8c10ea6507 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1366 microversion: 2.1 time: 0.241886 Sep 04 16:19:10.858507 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 378/749] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:10 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:11.091110 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-26cefd59-a68d-4ce4-be56-196292ab6353 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:11.091682 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-26cefd59-a68d-4ce4-be56-196292ab6353 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:11.101355 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26cefd59-a68d-4ce4-be56-196292ab6353 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:11.101792 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26cefd59-a68d-4ce4-be56-196292ab6353 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:11.102641 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26cefd59-a68d-4ce4-be56-196292ab6353 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:11.103332 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26cefd59-a68d-4ce4-be56-196292ab6353 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:11.104135 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26cefd59-a68d-4ce4-be56-196292ab6353 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:11.105053 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26cefd59-a68d-4ce4-be56-196292ab6353 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:11.247346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-26cefd59-a68d-4ce4-be56-196292ab6353 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:11.255790 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-26cefd59-a68d-4ce4-be56-196292ab6353 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:11.257318 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-26cefd59-a68d-4ce4-be56-196292ab6353 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:11.258475 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-26cefd59-a68d-4ce4-be56-196292ab6353 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1408 microversion: 2.20 time: 0.171696 Sep 04 16:19:11.259942 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 372/750] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:19:11 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:19:11.335653 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2d0b3327-7a88-4f43-b31c-f10e9d881b97 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:11.336519 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2d0b3327-7a88-4f43-b31c-f10e9d881b97 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:11.343043 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d0b3327-7a88-4f43-b31c-f10e9d881b97 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:11.344119 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d0b3327-7a88-4f43-b31c-f10e9d881b97 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:11.344428 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d0b3327-7a88-4f43-b31c-f10e9d881b97 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:11.345978 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d0b3327-7a88-4f43-b31c-f10e9d881b97 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:11.346445 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d0b3327-7a88-4f43-b31c-f10e9d881b97 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:11.346866 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2d0b3327-7a88-4f43-b31c-f10e9d881b97 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:11.435529 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-fc99a430-7811-4ea4-bb9f-91e6541956d7 req-c037952f-cd6d-44dd-9c44-d551c42cde60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0188e4a8-e601-43da-b389-7e0a8410ae8d", "tag": "ab492967-90e3-4b09-b251-d08c6b91d22c"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:19:11.445788 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-fc99a430-7811-4ea4-bb9f-91e6541956d7 req-c037952f-cd6d-44dd-9c44-d551c42cde60 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:11.447025 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-fc99a430-7811-4ea4-bb9f-91e6541956d7 req-c037952f-cd6d-44dd-9c44-d551c42cde60 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:11.447540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-fc99a430-7811-4ea4-bb9f-91e6541956d7 req-c037952f-cd6d-44dd-9c44-d551c42cde60 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:11.460390 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-fc99a430-7811-4ea4-bb9f-91e6541956d7 req-c037952f-cd6d-44dd-9c44-d551c42cde60 service nova] Creating event network-changed:ab492967-90e3-4b09-b251-d08c6b91d22c for instance 0188e4a8-e601-43da-b389-7e0a8410ae8d on hv-cinder-85236 Sep 04 16:19:11.468165 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-fc99a430-7811-4ea4-bb9f-91e6541956d7 req-c037952f-cd6d-44dd-9c44-d551c42cde60 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102400 Sep 04 16:19:11.468779 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 373/751] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:19:11.499481 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2d0b3327-7a88-4f43-b31c-f10e9d881b97 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:11.507338 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2d0b3327-7a88-4f43-b31c-f10e9d881b97 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1358 microversion: 2.1 time: 0.176092 Sep 04 16:19:11.507914 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 379/752] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:11 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:11.887379 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-540f3981-7bc0-4bf9-81ba-f26b6f3d5959 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:11.888200 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-540f3981-7bc0-4bf9-81ba-f26b6f3d5959 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:11.894746 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-540f3981-7bc0-4bf9-81ba-f26b6f3d5959 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:11.895301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-540f3981-7bc0-4bf9-81ba-f26b6f3d5959 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:11.895807 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-540f3981-7bc0-4bf9-81ba-f26b6f3d5959 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:11.896567 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-540f3981-7bc0-4bf9-81ba-f26b6f3d5959 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:11.897082 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-540f3981-7bc0-4bf9-81ba-f26b6f3d5959 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:11.897509 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-540f3981-7bc0-4bf9-81ba-f26b6f3d5959 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:11.918362 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:19:12.032860 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-540f3981-7bc0-4bf9-81ba-f26b6f3d5959 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:12.041282 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-540f3981-7bc0-4bf9-81ba-f26b6f3d5959 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1366 microversion: 2.1 time: 0.159155 Sep 04 16:19:12.041886 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 374/753] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:11 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:12.261252 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-0462c3ba-04c3-4e4f-9f10-731bb988926b req-198fa359-28cd-485a-8009-423f67c0cf3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73", "name": "network-vif-plugged", "status": "completed", "tag": "6d210ca9-1ff4-4f3e-842e-652e252e69a7"}, {"server_uuid": "b1c47389-a373-46bc-8601-5a0038fa00c6", "name": "network-vif-plugged", "status": "completed", "tag": "156cd70b-43a3-4b2d-899b-983cd2ad0541"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:19:12.272234 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0462c3ba-04c3-4e4f-9f10-731bb988926b req-198fa359-28cd-485a-8009-423f67c0cf3f service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:12.278281 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0462c3ba-04c3-4e4f-9f10-731bb988926b req-198fa359-28cd-485a-8009-423f67c0cf3f service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:12.278281 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-0462c3ba-04c3-4e4f-9f10-731bb988926b req-198fa359-28cd-485a-8009-423f67c0cf3f service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:12.278613 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:19:12.284648 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a50eab3d-35fd-4ba5-a083-17aac8a43f58 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:12.285889 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a50eab3d-35fd-4ba5-a083-17aac8a43f58 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:12.301302 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a50eab3d-35fd-4ba5-a083-17aac8a43f58 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:12.301850 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a50eab3d-35fd-4ba5-a083-17aac8a43f58 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:12.302295 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a50eab3d-35fd-4ba5-a083-17aac8a43f58 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:12.303004 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a50eab3d-35fd-4ba5-a083-17aac8a43f58 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:12.303551 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a50eab3d-35fd-4ba5-a083-17aac8a43f58 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:12.304157 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a50eab3d-35fd-4ba5-a083-17aac8a43f58 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:12.313959 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-0462c3ba-04c3-4e4f-9f10-731bb988926b req-198fa359-28cd-485a-8009-423f67c0cf3f service nova] Creating event network-vif-plugged:6d210ca9-1ff4-4f3e-842e-652e252e69a7 for instance ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 on hv-cinder-85236 Sep 04 16:19:12.314746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-0462c3ba-04c3-4e4f-9f10-731bb988926b req-198fa359-28cd-485a-8009-423f67c0cf3f service nova] Creating event network-vif-plugged:156cd70b-43a3-4b2d-899b-983cd2ad0541 for instance b1c47389-a373-46bc-8601-5a0038fa00c6 on hv-cinder-85236 Sep 04 16:19:12.338652 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-0462c3ba-04c3-4e4f-9f10-731bb988926b req-198fa359-28cd-485a-8009-423f67c0cf3f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.081592 Sep 04 16:19:12.339991 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 380/754] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:19:12.532696 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5569ad9a-8486-4da3-bcf4-f33612c84af8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:12.533409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5569ad9a-8486-4da3-bcf4-f33612c84af8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:12.539731 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a50eab3d-35fd-4ba5-a083-17aac8a43f58 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:12.540865 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5569ad9a-8486-4da3-bcf4-f33612c84af8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:12.541385 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5569ad9a-8486-4da3-bcf4-f33612c84af8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:12.541851 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5569ad9a-8486-4da3-bcf4-f33612c84af8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:12.543206 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5569ad9a-8486-4da3-bcf4-f33612c84af8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:12.543676 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5569ad9a-8486-4da3-bcf4-f33612c84af8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:12.544105 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5569ad9a-8486-4da3-bcf4-f33612c84af8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:12.552454 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a50eab3d-35fd-4ba5-a083-17aac8a43f58 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:12.554120 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a50eab3d-35fd-4ba5-a083-17aac8a43f58 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:12.555400 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a50eab3d-35fd-4ba5-a083-17aac8a43f58 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1408 microversion: 2.20 time: 0.274694 Sep 04 16:19:12.556599 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 375/755] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:19:12 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1408 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:19:12.856355 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5569ad9a-8486-4da3-bcf4-f33612c84af8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:12.864014 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5569ad9a-8486-4da3-bcf4-f33612c84af8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1358 microversion: 2.1 time: 0.336531 Sep 04 16:19:12.864575 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 381/756] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:12 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1358 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:19:13.064630 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-96c4e615-603c-4917-9394-d47fb7f3a15f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:13.065159 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-96c4e615-603c-4917-9394-d47fb7f3a15f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:13.071123 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-96c4e615-603c-4917-9394-d47fb7f3a15f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:13.071747 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-96c4e615-603c-4917-9394-d47fb7f3a15f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:13.072274 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-96c4e615-603c-4917-9394-d47fb7f3a15f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:13.072969 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-96c4e615-603c-4917-9394-d47fb7f3a15f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:13.073426 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-96c4e615-603c-4917-9394-d47fb7f3a15f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:13.073881 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-96c4e615-603c-4917-9394-d47fb7f3a15f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:13.208219 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-96c4e615-603c-4917-9394-d47fb7f3a15f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:13.216700 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-96c4e615-603c-4917-9394-d47fb7f3a15f tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1556 microversion: 2.1 time: 0.156005 Sep 04 16:19:13.217276 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 376/757] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:13 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:13.239890 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3d20c1b7-4e7a-4bf2-b33b-8db45f8caa3d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:13.240373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3d20c1b7-4e7a-4bf2-b33b-8db45f8caa3d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:13.246272 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d20c1b7-4e7a-4bf2-b33b-8db45f8caa3d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:13.246753 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d20c1b7-4e7a-4bf2-b33b-8db45f8caa3d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:13.247180 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d20c1b7-4e7a-4bf2-b33b-8db45f8caa3d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:13.247855 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d20c1b7-4e7a-4bf2-b33b-8db45f8caa3d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:13.248299 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d20c1b7-4e7a-4bf2-b33b-8db45f8caa3d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:13.248710 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d20c1b7-4e7a-4bf2-b33b-8db45f8caa3d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:13.328876 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3d20c1b7-4e7a-4bf2-b33b-8db45f8caa3d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092763 Sep 04 16:19:13.329731 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 382/758] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Sep 4 16:19:13 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:19:13.482369 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-531240ca-016f-4a9e-a104-cb47013f3506 req-7da3ef60-3100-433f-976b-48048c677e32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0188e4a8-e601-43da-b389-7e0a8410ae8d", "tag": "ab492967-90e3-4b09-b251-d08c6b91d22c"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:19:13.492134 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-531240ca-016f-4a9e-a104-cb47013f3506 req-7da3ef60-3100-433f-976b-48048c677e32 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:13.492608 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-531240ca-016f-4a9e-a104-cb47013f3506 req-7da3ef60-3100-433f-976b-48048c677e32 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:13.493641 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-531240ca-016f-4a9e-a104-cb47013f3506 req-7da3ef60-3100-433f-976b-48048c677e32 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:13.504733 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-531240ca-016f-4a9e-a104-cb47013f3506 req-7da3ef60-3100-433f-976b-48048c677e32 service nova] Creating event network-changed:ab492967-90e3-4b09-b251-d08c6b91d22c for instance 0188e4a8-e601-43da-b389-7e0a8410ae8d on hv-cinder-85236 Sep 04 16:19:13.510300 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-531240ca-016f-4a9e-a104-cb47013f3506 req-7da3ef60-3100-433f-976b-48048c677e32 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031512 Sep 04 16:19:13.510886 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 377/759] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:19:13.586713 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a42047b8-2190-487d-b84a-176a00c29017 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:13.586713 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a42047b8-2190-487d-b84a-176a00c29017 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:13.586713 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:19:13.591527 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a42047b8-2190-487d-b84a-176a00c29017 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:13.592023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a42047b8-2190-487d-b84a-176a00c29017 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:13.592454 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a42047b8-2190-487d-b84a-176a00c29017 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:13.593146 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a42047b8-2190-487d-b84a-176a00c29017 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:13.593620 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a42047b8-2190-487d-b84a-176a00c29017 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:13.594047 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a42047b8-2190-487d-b84a-176a00c29017 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:13.829899 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a42047b8-2190-487d-b84a-176a00c29017 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:13.840096 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a42047b8-2190-487d-b84a-176a00c29017 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:13.841452 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a42047b8-2190-487d-b84a-176a00c29017 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:13.842660 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a42047b8-2190-487d-b84a-176a00c29017 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1408 microversion: 2.20 time: 0.263089 Sep 04 16:19:13.843130 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 383/760] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:19:13 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1408 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:19:13.888102 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7f8b4e2e-2962-4ffa-943f-0e55347bdb47 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:13.888803 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7f8b4e2e-2962-4ffa-943f-0e55347bdb47 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:13.895300 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7f8b4e2e-2962-4ffa-943f-0e55347bdb47 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:13.895786 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7f8b4e2e-2962-4ffa-943f-0e55347bdb47 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:13.901301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7f8b4e2e-2962-4ffa-943f-0e55347bdb47 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:13.901301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7f8b4e2e-2962-4ffa-943f-0e55347bdb47 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:13.901301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7f8b4e2e-2962-4ffa-943f-0e55347bdb47 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:13.901301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7f8b4e2e-2962-4ffa-943f-0e55347bdb47 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:14.108763 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7f8b4e2e-2962-4ffa-943f-0e55347bdb47 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:14.116814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7f8b4e2e-2962-4ffa-943f-0e55347bdb47 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1358 microversion: 2.1 time: 0.234231 Sep 04 16:19:14.132982 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 378/761] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:13 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:14.869374 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1fd14bfc-5a9f-4084-8eaa-29a349e66010 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:14.870075 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1fd14bfc-5a9f-4084-8eaa-29a349e66010 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:14.876164 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1fd14bfc-5a9f-4084-8eaa-29a349e66010 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:14.876661 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1fd14bfc-5a9f-4084-8eaa-29a349e66010 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:14.877102 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1fd14bfc-5a9f-4084-8eaa-29a349e66010 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:14.877824 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1fd14bfc-5a9f-4084-8eaa-29a349e66010 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:14.878452 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1fd14bfc-5a9f-4084-8eaa-29a349e66010 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:14.878889 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1fd14bfc-5a9f-4084-8eaa-29a349e66010 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:14.889666 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-6d841729-7ea6-45c0-bef9-b9dc7ed4a78a req-ea3bf708-279d-440e-820c-0b2a35eba7c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e5636f2-5f2f-45ca-af8a-d998079502df", "tag": "5109bc3e-5bc8-407d-b0e7-4d3d700d2044"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:19:14.901885 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6d841729-7ea6-45c0-bef9-b9dc7ed4a78a req-ea3bf708-279d-440e-820c-0b2a35eba7c6 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:14.902818 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6d841729-7ea6-45c0-bef9-b9dc7ed4a78a req-ea3bf708-279d-440e-820c-0b2a35eba7c6 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:14.903318 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6d841729-7ea6-45c0-bef9-b9dc7ed4a78a req-ea3bf708-279d-440e-820c-0b2a35eba7c6 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:14.915535 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-6d841729-7ea6-45c0-bef9-b9dc7ed4a78a req-ea3bf708-279d-440e-820c-0b2a35eba7c6 service nova] Creating event network-changed:5109bc3e-5bc8-407d-b0e7-4d3d700d2044 for instance 9e5636f2-5f2f-45ca-af8a-d998079502df on hv-cinder-85236 Sep 04 16:19:14.921003 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-6d841729-7ea6-45c0-bef9-b9dc7ed4a78a req-ea3bf708-279d-440e-820c-0b2a35eba7c6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104781 Sep 04 16:19:14.921701 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 384/762] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:19:15.019304 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1fd14bfc-5a9f-4084-8eaa-29a349e66010 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:15.027766 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1fd14bfc-5a9f-4084-8eaa-29a349e66010 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:15.029224 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1fd14bfc-5a9f-4084-8eaa-29a349e66010 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:15.030479 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1fd14bfc-5a9f-4084-8eaa-29a349e66010 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1600 microversion: 2.20 time: 0.166715 Sep 04 16:19:15.031040 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 379/763] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:19:14 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1600 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:19:15.056787 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eea3059c-93c0-4382-9aed-1aa574cdfcfa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:15.057608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-eea3059c-93c0-4382-9aed-1aa574cdfcfa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:15.063942 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eea3059c-93c0-4382-9aed-1aa574cdfcfa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:15.064434 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eea3059c-93c0-4382-9aed-1aa574cdfcfa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:15.064877 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eea3059c-93c0-4382-9aed-1aa574cdfcfa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:15.065608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eea3059c-93c0-4382-9aed-1aa574cdfcfa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:15.066070 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eea3059c-93c0-4382-9aed-1aa574cdfcfa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:15.066498 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-eea3059c-93c0-4382-9aed-1aa574cdfcfa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:15.140397 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fece2f89-8690-4961-a4dc-c135d597004d tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:15.141012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fece2f89-8690-4961-a4dc-c135d597004d tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:15.144258 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eea3059c-93c0-4382-9aed-1aa574cdfcfa tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092082 Sep 04 16:19:15.145062 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 385/764] 10.222.0.39 () {60 vars in 1316 bytes} [Sun Sep 4 16:19:15 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:19:15.147433 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fece2f89-8690-4961-a4dc-c135d597004d tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:15.147925 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fece2f89-8690-4961-a4dc-c135d597004d tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:15.148360 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fece2f89-8690-4961-a4dc-c135d597004d tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:15.149061 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fece2f89-8690-4961-a4dc-c135d597004d tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:15.149514 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fece2f89-8690-4961-a4dc-c135d597004d tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:15.150292 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fece2f89-8690-4961-a4dc-c135d597004d tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:15.617932 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fece2f89-8690-4961-a4dc-c135d597004d tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:15.626079 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fece2f89-8690-4961-a4dc-c135d597004d tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1549 microversion: 2.1 time: 0.489520 Sep 04 16:19:15.626655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 380/765] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:15 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1549 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:19:15.649110 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3627e7e6-72e9-4391-9efe-dc89137e6d70 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:15.650538 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3627e7e6-72e9-4391-9efe-dc89137e6d70 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:15.656825 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3627e7e6-72e9-4391-9efe-dc89137e6d70 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:15.657306 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3627e7e6-72e9-4391-9efe-dc89137e6d70 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:15.657782 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3627e7e6-72e9-4391-9efe-dc89137e6d70 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:15.658471 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3627e7e6-72e9-4391-9efe-dc89137e6d70 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:15.658922 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3627e7e6-72e9-4391-9efe-dc89137e6d70 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:15.659338 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3627e7e6-72e9-4391-9efe-dc89137e6d70 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:16.141232 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-3627e7e6-72e9-4391-9efe-dc89137e6d70 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:16.149211 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3627e7e6-72e9-4391-9efe-dc89137e6d70 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1549 microversion: 2.1 time: 0.504273 Sep 04 16:19:16.153437 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 386/766] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:15 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1549 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:16.172360 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c523f82a-e3d6-4108-83b3-b894c273c54f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:16.177413 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c523f82a-e3d6-4108-83b3-b894c273c54f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:16.178204 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c523f82a-e3d6-4108-83b3-b894c273c54f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Searching by: {'deleted': False, 'project_id': 'ae092c3124e9438fa20dfda624775825'} {{(pid=121041) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 04 16:19:16.185334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c523f82a-e3d6-4108-83b3-b894c273c54f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:16.185852 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c523f82a-e3d6-4108-83b3-b894c273c54f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:16.186280 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c523f82a-e3d6-4108-83b3-b894c273c54f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:16.186991 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c523f82a-e3d6-4108-83b3-b894c273c54f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:16.187464 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c523f82a-e3d6-4108-83b3-b894c273c54f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:16.187882 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c523f82a-e3d6-4108-83b3-b894c273c54f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:16.280375 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.multi_cell_list [None req-c523f82a-e3d6-4108-83b3-b894c273c54f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121041) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 04 16:19:16.375293 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c523f82a-e3d6-4108-83b3-b894c273c54f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.206676 Sep 04 16:19:16.375891 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 381/767] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Sep 4 16:19:16 2022] GET /compute/v2.1/servers => generated 343 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:19:16.388016 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1dbb5c88-c43e-4a8e-9d8a-6fb9d2c48f0d tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:16.388616 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1dbb5c88-c43e-4a8e-9d8a-6fb9d2c48f0d tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:16.394804 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dbb5c88-c43e-4a8e-9d8a-6fb9d2c48f0d tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:16.395280 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dbb5c88-c43e-4a8e-9d8a-6fb9d2c48f0d tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:16.395705 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dbb5c88-c43e-4a8e-9d8a-6fb9d2c48f0d tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:16.396394 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dbb5c88-c43e-4a8e-9d8a-6fb9d2c48f0d tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:16.396837 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dbb5c88-c43e-4a8e-9d8a-6fb9d2c48f0d tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:16.397433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1dbb5c88-c43e-4a8e-9d8a-6fb9d2c48f0d tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:16.998496 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1dbb5c88-c43e-4a8e-9d8a-6fb9d2c48f0d tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:17.006739 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1dbb5c88-c43e-4a8e-9d8a-6fb9d2c48f0d tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1549 microversion: 2.1 time: 0.622765 Sep 04 16:19:17.007519 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 387/768] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:16 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1549 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:17.324373 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-9afb7108-0737-46cf-947e-b757bb886490 req-30698471-83c5-4f71-a08b-d99411593c96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73", "tag": "6d210ca9-1ff4-4f3e-842e-652e252e69a7"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:19:17.335824 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-9afb7108-0737-46cf-947e-b757bb886490 req-30698471-83c5-4f71-a08b-d99411593c96 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:17.336294 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-9afb7108-0737-46cf-947e-b757bb886490 req-30698471-83c5-4f71-a08b-d99411593c96 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:17.337882 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-9afb7108-0737-46cf-947e-b757bb886490 req-30698471-83c5-4f71-a08b-d99411593c96 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:17.349215 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-9afb7108-0737-46cf-947e-b757bb886490 req-30698471-83c5-4f71-a08b-d99411593c96 service nova] Creating event network-changed:6d210ca9-1ff4-4f3e-842e-652e252e69a7 for instance ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 on hv-cinder-85236 Sep 04 16:19:17.354607 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-9afb7108-0737-46cf-947e-b757bb886490 req-30698471-83c5-4f71-a08b-d99411593c96 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034833 Sep 04 16:19:17.355211 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 382/769] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:19:18.872575 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-42573c49-8677-45fc-9dfb-8431a1a01797 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3bc9790f-1243-477e-85cf-76f68b1caad7"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:19:18.875056 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-42573c49-8677-45fc-9dfb-8431a1a01797 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:18.881517 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42573c49-8677-45fc-9dfb-8431a1a01797 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:18.882033 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42573c49-8677-45fc-9dfb-8431a1a01797 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:18.882501 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42573c49-8677-45fc-9dfb-8431a1a01797 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:18.883181 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42573c49-8677-45fc-9dfb-8431a1a01797 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:18.883632 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42573c49-8677-45fc-9dfb-8431a1a01797 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:18.884310 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-42573c49-8677-45fc-9dfb-8431a1a01797 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:19.621388 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-42573c49-8677-45fc-9dfb-8431a1a01797 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "POST /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.753382 Sep 04 16:19:19.622076 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 388/770] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Sep 4 16:19:18 2022] POST /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6/os-volume_attachments => generated 194 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:19:27.213333 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:19:27.217631 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0d0a0d68-fc34-4efb-bcbb-efab2d61953e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:27.218327 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0d0a0d68-fc34-4efb-bcbb-efab2d61953e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:27.220068 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=74 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:19:27.225010 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0d0a0d68-fc34-4efb-bcbb-efab2d61953e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:27.228957 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0d0a0d68-fc34-4efb-bcbb-efab2d61953e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:27.228957 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0d0a0d68-fc34-4efb-bcbb-efab2d61953e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:27.228957 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0d0a0d68-fc34-4efb-bcbb-efab2d61953e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:27.228957 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0d0a0d68-fc34-4efb-bcbb-efab2d61953e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:27.229361 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0d0a0d68-fc34-4efb-bcbb-efab2d61953e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:27.363760 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0d0a0d68-fc34-4efb-bcbb-efab2d61953e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:27.372944 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0d0a0d68-fc34-4efb-bcbb-efab2d61953e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1595 microversion: 2.1 time: 0.161571 Sep 04 16:19:27.373505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 383/771] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:27 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1595 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:29.333907 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-12deaa7a-8504-4a99-9575-6151358e43e7 req-884ce8b2-803b-48be-8e93-28c73c75e8a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1c47389-a373-46bc-8601-5a0038fa00c6", "tag": "156cd70b-43a3-4b2d-899b-983cd2ad0541"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:19:29.340040 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=11 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:19:29.346250 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-12deaa7a-8504-4a99-9575-6151358e43e7 req-884ce8b2-803b-48be-8e93-28c73c75e8a9 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:29.346800 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-12deaa7a-8504-4a99-9575-6151358e43e7 req-884ce8b2-803b-48be-8e93-28c73c75e8a9 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:29.347293 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-12deaa7a-8504-4a99-9575-6151358e43e7 req-884ce8b2-803b-48be-8e93-28c73c75e8a9 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:29.360120 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-12deaa7a-8504-4a99-9575-6151358e43e7 req-884ce8b2-803b-48be-8e93-28c73c75e8a9 service nova] Creating event network-changed:156cd70b-43a3-4b2d-899b-983cd2ad0541 for instance b1c47389-a373-46bc-8601-5a0038fa00c6 on hv-cinder-85236 Sep 04 16:19:29.365389 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-12deaa7a-8504-4a99-9575-6151358e43e7 req-884ce8b2-803b-48be-8e93-28c73c75e8a9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040925 Sep 04 16:19:29.366231 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 389/772] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:19:31.706278 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c5164268-1388-43dd-9b63-7e09ba0e0c7a tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-681660327"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:19:31.706859 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c5164268-1388-43dd-9b63-7e09ba0e0c7a tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:31.713309 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c5164268-1388-43dd-9b63-7e09ba0e0c7a tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:31.713828 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c5164268-1388-43dd-9b63-7e09ba0e0c7a tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:31.714272 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c5164268-1388-43dd-9b63-7e09ba0e0c7a tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:31.714965 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c5164268-1388-43dd-9b63-7e09ba0e0c7a tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:31.715420 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c5164268-1388-43dd-9b63-7e09ba0e0c7a tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:31.715848 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c5164268-1388-43dd-9b63-7e09ba0e0c7a tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:31.849517 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.network.security_group_api [None req-c5164268-1388-43dd-9b63-7e09ba0e0c7a tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Adding security group 6b43c59d-2f27-4597-acd9-80f09a1d361f to port 156cd70b-43a3-4b2d-899b-983cd2ad0541 Sep 04 16:19:32.217948 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c5164268-1388-43dd-9b63-7e09ba0e0c7a tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "POST /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6/action" status: 202 len: 0 microversion: 2.1 time: 0.515508 Sep 04 16:19:32.219599 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 384/773] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Sep 4 16:19:31 2022] POST /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:19:32.229209 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-0c2efd3e-e853-4452-8c14-7040ec916156 req-5347ab27-5739-4974-9274-afccc66cb179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1c47389-a373-46bc-8601-5a0038fa00c6", "tag": "156cd70b-43a3-4b2d-899b-983cd2ad0541"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:19:32.229639 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dea50dd7-ce2c-410d-b513-cb66686c2206 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:32.230496 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dea50dd7-ce2c-410d-b513-cb66686c2206 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:32.239097 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dea50dd7-ce2c-410d-b513-cb66686c2206 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:32.239704 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dea50dd7-ce2c-410d-b513-cb66686c2206 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:32.240235 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dea50dd7-ce2c-410d-b513-cb66686c2206 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:32.241025 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dea50dd7-ce2c-410d-b513-cb66686c2206 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:32.241731 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dea50dd7-ce2c-410d-b513-cb66686c2206 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:32.242358 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dea50dd7-ce2c-410d-b513-cb66686c2206 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:32.242506 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-0c2efd3e-e853-4452-8c14-7040ec916156 req-5347ab27-5739-4974-9274-afccc66cb179 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:32.243175 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-0c2efd3e-e853-4452-8c14-7040ec916156 req-5347ab27-5739-4974-9274-afccc66cb179 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:32.245058 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-0c2efd3e-e853-4452-8c14-7040ec916156 req-5347ab27-5739-4974-9274-afccc66cb179 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:32.260236 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-0c2efd3e-e853-4452-8c14-7040ec916156 req-5347ab27-5739-4974-9274-afccc66cb179 service nova] Creating event network-changed:156cd70b-43a3-4b2d-899b-983cd2ad0541 for instance b1c47389-a373-46bc-8601-5a0038fa00c6 on hv-cinder-85236 Sep 04 16:19:32.267214 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-0c2efd3e-e853-4452-8c14-7040ec916156 req-5347ab27-5739-4974-9274-afccc66cb179 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042128 Sep 04 16:19:32.268823 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 385/774] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:19:32.484358 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-dea50dd7-ce2c-410d-b513-cb66686c2206 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:32.493902 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dea50dd7-ce2c-410d-b513-cb66686c2206 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1760 microversion: 2.1 time: 0.270795 Sep 04 16:19:32.494674 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 390/775] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:32 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1760 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:52.464801 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b3284652-f45b-4fa9-9146-1188bbb28562 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:52.465383 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b3284652-f45b-4fa9-9146-1188bbb28562 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:52.467508 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=5 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:19:52.468161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=56 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:19:52.473281 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3284652-f45b-4fa9-9146-1188bbb28562 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:52.473829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3284652-f45b-4fa9-9146-1188bbb28562 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:52.474268 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3284652-f45b-4fa9-9146-1188bbb28562 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:52.475005 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3284652-f45b-4fa9-9146-1188bbb28562 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:52.475457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3284652-f45b-4fa9-9146-1188bbb28562 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:52.475879 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3284652-f45b-4fa9-9146-1188bbb28562 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:52.559419 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-b3284652-f45b-4fa9-9146-1188bbb28562 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lazy-loading 'services' on Instance uuid 0188e4a8-e601-43da-b389-7e0a8410ae8d {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:19:52.760218 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b3284652-f45b-4fa9-9146-1188bbb28562 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d/os-volume_attachments/80716f97-c736-4682-bf4f-b71c2ee354bf" status: 202 len: 0 microversion: 2.1 time: 0.299837 Sep 04 16:19:52.761371 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 386/776] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Sep 4 16:19:52 2022] DELETE /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d/os-volume_attachments/80716f97-c736-4682-bf4f-b71c2ee354bf => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:19:52.769661 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4ee39a8d-902b-45c8-8885-11a5aa65edc1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:52.772045 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4ee39a8d-902b-45c8-8885-11a5aa65edc1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:52.774567 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:19:52.775238 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:19:52.780753 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ee39a8d-902b-45c8-8885-11a5aa65edc1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:52.781235 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ee39a8d-902b-45c8-8885-11a5aa65edc1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:52.781697 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ee39a8d-902b-45c8-8885-11a5aa65edc1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:52.782385 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ee39a8d-902b-45c8-8885-11a5aa65edc1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:52.782833 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ee39a8d-902b-45c8-8885-11a5aa65edc1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:52.783249 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4ee39a8d-902b-45c8-8885-11a5aa65edc1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:52.813217 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4ee39a8d-902b-45c8-8885-11a5aa65edc1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047477 Sep 04 16:19:52.813817 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 391/777] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:19:52 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:19:53.827763 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c852ffa5-9cb4-42ab-9a02-de302b9df436 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:53.830104 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c852ffa5-9cb4-42ab-9a02-de302b9df436 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:53.836293 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c852ffa5-9cb4-42ab-9a02-de302b9df436 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:53.836777 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c852ffa5-9cb4-42ab-9a02-de302b9df436 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:53.837215 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c852ffa5-9cb4-42ab-9a02-de302b9df436 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:53.837960 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c852ffa5-9cb4-42ab-9a02-de302b9df436 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:53.838395 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c852ffa5-9cb4-42ab-9a02-de302b9df436 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:53.840087 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c852ffa5-9cb4-42ab-9a02-de302b9df436 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:53.869135 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c852ffa5-9cb4-42ab-9a02-de302b9df436 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046823 Sep 04 16:19:53.869702 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 387/778] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:19:53 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:19:54.291693 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b333c33e-4c8a-4ef3-8c72-eb952ccc2b42 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:19:54.292884 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b333c33e-4c8a-4ef3-8c72-eb952ccc2b42 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:54.300134 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b333c33e-4c8a-4ef3-8c72-eb952ccc2b42 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:54.300617 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b333c33e-4c8a-4ef3-8c72-eb952ccc2b42 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:54.301054 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b333c33e-4c8a-4ef3-8c72-eb952ccc2b42 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:54.301778 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b333c33e-4c8a-4ef3-8c72-eb952ccc2b42 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:54.302238 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b333c33e-4c8a-4ef3-8c72-eb952ccc2b42 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:54.302662 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b333c33e-4c8a-4ef3-8c72-eb952ccc2b42 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:54.326290 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-b333c33e-4c8a-4ef3-8c72-eb952ccc2b42 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lazy-loading 'flavor' on Instance uuid 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:19:54.576648 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b333c33e-4c8a-4ef3-8c72-eb952ccc2b42 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "POST /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc/action" status: 202 len: 0 microversion: 2.1 time: 0.289063 Sep 04 16:19:54.577151 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 392/779] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Sep 4 16:19:54 2022] POST /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:19:54.585347 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-05f105ad-8237-4228-91b0-4b0c11c0a039 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:54.585984 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-05f105ad-8237-4228-91b0-4b0c11c0a039 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:54.592006 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-05f105ad-8237-4228-91b0-4b0c11c0a039 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:54.592510 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-05f105ad-8237-4228-91b0-4b0c11c0a039 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:54.592933 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-05f105ad-8237-4228-91b0-4b0c11c0a039 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:54.593653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-05f105ad-8237-4228-91b0-4b0c11c0a039 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:54.594135 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-05f105ad-8237-4228-91b0-4b0c11c0a039 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:54.599433 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-05f105ad-8237-4228-91b0-4b0c11c0a039 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:54.736613 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-05f105ad-8237-4228-91b0-4b0c11c0a039 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:54.744344 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-05f105ad-8237-4228-91b0-4b0c11c0a039 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1569 microversion: 2.1 time: 0.162855 Sep 04 16:19:54.744914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 388/780] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:54 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:54.881844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cf50dd1a-7f76-4f8c-ba0e-e27a3e2cc1eb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:54.884071 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cf50dd1a-7f76-4f8c-ba0e-e27a3e2cc1eb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:54.891078 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf50dd1a-7f76-4f8c-ba0e-e27a3e2cc1eb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:54.891554 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf50dd1a-7f76-4f8c-ba0e-e27a3e2cc1eb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:54.891991 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf50dd1a-7f76-4f8c-ba0e-e27a3e2cc1eb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:54.892675 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf50dd1a-7f76-4f8c-ba0e-e27a3e2cc1eb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:54.899036 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf50dd1a-7f76-4f8c-ba0e-e27a3e2cc1eb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:54.899935 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cf50dd1a-7f76-4f8c-ba0e-e27a3e2cc1eb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:54.929426 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cf50dd1a-7f76-4f8c-ba0e-e27a3e2cc1eb tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051986 Sep 04 16:19:54.930010 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 393/781] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:19:54 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 04 16:19:55.015507 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-98ee4cea-2035-488a-9bbd-c72ded972ba5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:55.016152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-98ee4cea-2035-488a-9bbd-c72ded972ba5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:55.023412 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-98ee4cea-2035-488a-9bbd-c72ded972ba5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:55.023905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-98ee4cea-2035-488a-9bbd-c72ded972ba5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:55.024343 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-98ee4cea-2035-488a-9bbd-c72ded972ba5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:55.025039 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-98ee4cea-2035-488a-9bbd-c72ded972ba5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:55.025489 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-98ee4cea-2035-488a-9bbd-c72ded972ba5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:55.025964 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-98ee4cea-2035-488a-9bbd-c72ded972ba5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:55.055531 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-98ee4cea-2035-488a-9bbd-c72ded972ba5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 16:19:55.356547 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-98ee4cea-2035-488a-9bbd-c72ded972ba5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 204 len: 0 microversion: 2.1 time: 0.345625 Sep 04 16:19:55.357135 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 389/782] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:19:55 2022] DELETE /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 16:19:55.365025 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-585500a9-7d75-477c-99e3-4e457a200d0c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:55.365714 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-585500a9-7d75-477c-99e3-4e457a200d0c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:55.373522 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-585500a9-7d75-477c-99e3-4e457a200d0c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:55.374030 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-585500a9-7d75-477c-99e3-4e457a200d0c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:55.374460 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-585500a9-7d75-477c-99e3-4e457a200d0c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:55.375149 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-585500a9-7d75-477c-99e3-4e457a200d0c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:55.375591 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-585500a9-7d75-477c-99e3-4e457a200d0c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:55.376023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-585500a9-7d75-477c-99e3-4e457a200d0c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:55.509801 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-585500a9-7d75-477c-99e3-4e457a200d0c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:55.517891 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-585500a9-7d75-477c-99e3-4e457a200d0c tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1687 microversion: 2.1 time: 0.156567 Sep 04 16:19:55.518462 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 394/783] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:55 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:55.770044 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cc40ddd5-0f34-4edd-84ff-1bad7d34998e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:55.770902 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cc40ddd5-0f34-4edd-84ff-1bad7d34998e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:55.777140 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cc40ddd5-0f34-4edd-84ff-1bad7d34998e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:55.777748 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cc40ddd5-0f34-4edd-84ff-1bad7d34998e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:55.778189 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cc40ddd5-0f34-4edd-84ff-1bad7d34998e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:55.778872 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cc40ddd5-0f34-4edd-84ff-1bad7d34998e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:55.779324 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cc40ddd5-0f34-4edd-84ff-1bad7d34998e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:55.779746 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cc40ddd5-0f34-4edd-84ff-1bad7d34998e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:55.911924 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-cc40ddd5-0f34-4edd-84ff-1bad7d34998e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:55.920307 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cc40ddd5-0f34-4edd-84ff-1bad7d34998e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1569 microversion: 2.1 time: 0.154646 Sep 04 16:19:55.920868 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 390/784] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:55 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:56.541706 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6abcfdf8-1a32-4e40-be90-7d4bf25b1c50 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:56.542810 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6abcfdf8-1a32-4e40-be90-7d4bf25b1c50 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:56.549271 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6abcfdf8-1a32-4e40-be90-7d4bf25b1c50 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:56.549782 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6abcfdf8-1a32-4e40-be90-7d4bf25b1c50 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:56.550210 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6abcfdf8-1a32-4e40-be90-7d4bf25b1c50 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:56.550886 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6abcfdf8-1a32-4e40-be90-7d4bf25b1c50 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:56.551331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6abcfdf8-1a32-4e40-be90-7d4bf25b1c50 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:56.551745 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6abcfdf8-1a32-4e40-be90-7d4bf25b1c50 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:56.679663 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-6abcfdf8-1a32-4e40-be90-7d4bf25b1c50 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:56.688071 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6abcfdf8-1a32-4e40-be90-7d4bf25b1c50 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1687 microversion: 2.1 time: 0.150356 Sep 04 16:19:56.688629 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 395/785] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:56 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1687 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:56.943244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-588813f5-2328-470c-9d5d-9271e01068cf tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:56.943877 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-588813f5-2328-470c-9d5d-9271e01068cf tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:56.950914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-588813f5-2328-470c-9d5d-9271e01068cf tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:56.951384 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-588813f5-2328-470c-9d5d-9271e01068cf tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:56.951810 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-588813f5-2328-470c-9d5d-9271e01068cf tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:56.952484 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-588813f5-2328-470c-9d5d-9271e01068cf tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:56.952931 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-588813f5-2328-470c-9d5d-9271e01068cf tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:56.953350 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-588813f5-2328-470c-9d5d-9271e01068cf tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:57.082825 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-588813f5-2328-470c-9d5d-9271e01068cf tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:57.091557 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-588813f5-2328-470c-9d5d-9271e01068cf tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1569 microversion: 2.1 time: 0.152187 Sep 04 16:19:57.092127 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 391/786] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:56 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:57.711720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-63f976c1-b95d-4087-a38a-0e14099cb28d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:57.712264 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-63f976c1-b95d-4087-a38a-0e14099cb28d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:57.719189 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63f976c1-b95d-4087-a38a-0e14099cb28d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:57.719663 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63f976c1-b95d-4087-a38a-0e14099cb28d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:57.720090 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63f976c1-b95d-4087-a38a-0e14099cb28d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:57.720769 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63f976c1-b95d-4087-a38a-0e14099cb28d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:57.721234 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63f976c1-b95d-4087-a38a-0e14099cb28d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:57.721684 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63f976c1-b95d-4087-a38a-0e14099cb28d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:57.855787 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-63f976c1-b95d-4087-a38a-0e14099cb28d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:57.863399 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-63f976c1-b95d-4087-a38a-0e14099cb28d tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1687 microversion: 2.1 time: 0.155676 Sep 04 16:19:57.865652 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 396/787] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:57 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:57.914567 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d776fd37-fea3-43c5-a38c-388f6bdedf48 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:57.915067 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d776fd37-fea3-43c5-a38c-388f6bdedf48 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:57.921065 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d776fd37-fea3-43c5-a38c-388f6bdedf48 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:57.921548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d776fd37-fea3-43c5-a38c-388f6bdedf48 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:57.922018 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d776fd37-fea3-43c5-a38c-388f6bdedf48 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:57.922705 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d776fd37-fea3-43c5-a38c-388f6bdedf48 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:57.923159 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d776fd37-fea3-43c5-a38c-388f6bdedf48 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:57.923581 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d776fd37-fea3-43c5-a38c-388f6bdedf48 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:57.947972 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d776fd37-fea3-43c5-a38c-388f6bdedf48 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 16:19:58.114790 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2e9daac6-83b1-4f3c-b74e-6c6b698713b5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:58.115395 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2e9daac6-83b1-4f3c-b74e-6c6b698713b5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:58.122628 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e9daac6-83b1-4f3c-b74e-6c6b698713b5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:58.123112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e9daac6-83b1-4f3c-b74e-6c6b698713b5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:58.123558 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e9daac6-83b1-4f3c-b74e-6c6b698713b5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:58.124244 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e9daac6-83b1-4f3c-b74e-6c6b698713b5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:58.124692 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e9daac6-83b1-4f3c-b74e-6c6b698713b5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:58.125114 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e9daac6-83b1-4f3c-b74e-6c6b698713b5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:58.188349 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d776fd37-fea3-43c5-a38c-388f6bdedf48 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 204 len: 0 microversion: 2.1 time: 0.277471 Sep 04 16:19:58.189065 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 392/788] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:19:57 2022] DELETE /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 16:19:58.197383 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-77ff3ba0-956a-441e-8bdc-5e12923b93e3 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:58.198105 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-77ff3ba0-956a-441e-8bdc-5e12923b93e3 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:58.205153 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-77ff3ba0-956a-441e-8bdc-5e12923b93e3 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:58.205676 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-77ff3ba0-956a-441e-8bdc-5e12923b93e3 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:58.206115 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-77ff3ba0-956a-441e-8bdc-5e12923b93e3 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:58.206807 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-77ff3ba0-956a-441e-8bdc-5e12923b93e3 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:58.207257 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-77ff3ba0-956a-441e-8bdc-5e12923b93e3 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:58.207680 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-77ff3ba0-956a-441e-8bdc-5e12923b93e3 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:58.284647 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2e9daac6-83b1-4f3c-b74e-6c6b698713b5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:58.292542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2e9daac6-83b1-4f3c-b74e-6c6b698713b5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1569 microversion: 2.1 time: 0.181454 Sep 04 16:19:58.293124 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 397/789] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:58 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:19:58.297602 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-315b44a4-c431-4fde-a736-04e3e601695d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:58.298097 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-315b44a4-c431-4fde-a736-04e3e601695d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:58.304339 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-315b44a4-c431-4fde-a736-04e3e601695d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:58.304829 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-315b44a4-c431-4fde-a736-04e3e601695d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:58.305267 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-315b44a4-c431-4fde-a736-04e3e601695d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:58.305999 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-315b44a4-c431-4fde-a736-04e3e601695d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:58.306456 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-315b44a4-c431-4fde-a736-04e3e601695d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:58.306883 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-315b44a4-c431-4fde-a736-04e3e601695d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:58.332401 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-315b44a4-c431-4fde-a736-04e3e601695d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df/ips" status: 200 len: 150 microversion: 2.1 time: 0.038209 Sep 04 16:19:58.333274 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 398/790] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Sep 4 16:19:58 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:19:58.362683 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-77ff3ba0-956a-441e-8bdc-5e12923b93e3 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:58.366395 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-77ff3ba0-956a-441e-8bdc-5e12923b93e3 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1578 microversion: 2.1 time: 0.173003 Sep 04 16:19:58.366997 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 393/791] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:58 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:58.887978 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-da06e1e1-91e3-4fcd-81c5-d80598be0394 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:58.888521 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-da06e1e1-91e3-4fcd-81c5-d80598be0394 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:58.894887 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da06e1e1-91e3-4fcd-81c5-d80598be0394 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:58.895361 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da06e1e1-91e3-4fcd-81c5-d80598be0394 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:58.896050 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da06e1e1-91e3-4fcd-81c5-d80598be0394 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:58.897396 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da06e1e1-91e3-4fcd-81c5-d80598be0394 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:58.897881 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da06e1e1-91e3-4fcd-81c5-d80598be0394 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:58.898297 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da06e1e1-91e3-4fcd-81c5-d80598be0394 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:59.033335 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-da06e1e1-91e3-4fcd-81c5-d80598be0394 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:59.040909 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-da06e1e1-91e3-4fcd-81c5-d80598be0394 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1687 microversion: 2.1 time: 0.157584 Sep 04 16:19:59.042835 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 399/792] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:58 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:59.317592 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cd347306-e8ec-4c4f-a85c-9a4889bb4c59 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:59.318130 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cd347306-e8ec-4c4f-a85c-9a4889bb4c59 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:59.324787 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd347306-e8ec-4c4f-a85c-9a4889bb4c59 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:59.325263 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd347306-e8ec-4c4f-a85c-9a4889bb4c59 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:59.325719 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd347306-e8ec-4c4f-a85c-9a4889bb4c59 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:59.326405 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd347306-e8ec-4c4f-a85c-9a4889bb4c59 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:59.326851 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd347306-e8ec-4c4f-a85c-9a4889bb4c59 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:59.327265 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd347306-e8ec-4c4f-a85c-9a4889bb4c59 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:59.390957 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c43a4a33-df52-42d7-adf0-92966ab1ff14 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:19:59.391725 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c43a4a33-df52-42d7-adf0-92966ab1ff14 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:59.397990 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c43a4a33-df52-42d7-adf0-92966ab1ff14 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:59.403248 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c43a4a33-df52-42d7-adf0-92966ab1ff14 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:59.403248 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c43a4a33-df52-42d7-adf0-92966ab1ff14 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:59.403248 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c43a4a33-df52-42d7-adf0-92966ab1ff14 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:59.403248 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c43a4a33-df52-42d7-adf0-92966ab1ff14 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:59.403669 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c43a4a33-df52-42d7-adf0-92966ab1ff14 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:59.493522 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-cd347306-e8ec-4c4f-a85c-9a4889bb4c59 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:59.502959 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cd347306-e8ec-4c4f-a85c-9a4889bb4c59 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1569 microversion: 2.1 time: 0.189092 Sep 04 16:19:59.503966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 394/793] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:59 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1569 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:19:59.560374 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c43a4a33-df52-42d7-adf0-92966ab1ff14 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:19:59.568142 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c43a4a33-df52-42d7-adf0-92966ab1ff14 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1578 microversion: 2.1 time: 0.181116 Sep 04 16:19:59.568652 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 400/794] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:19:59 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1578 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:19:59.944988 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-46987051-f5f8-4ada-8003-ae59aef35067 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78d5260a-7670-4216-a149-eca97dcee6a2"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:19:59.947401 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-46987051-f5f8-4ada-8003-ae59aef35067 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:19:59.954019 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46987051-f5f8-4ada-8003-ae59aef35067 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:59.957480 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46987051-f5f8-4ada-8003-ae59aef35067 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:59.957480 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46987051-f5f8-4ada-8003-ae59aef35067 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:19:59.957480 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46987051-f5f8-4ada-8003-ae59aef35067 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:19:59.957480 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46987051-f5f8-4ada-8003-ae59aef35067 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:19:59.957893 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46987051-f5f8-4ada-8003-ae59aef35067 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:00.064411 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-46905207-4565-4941-ad9c-3612c49954ad tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:00.065023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-46905207-4565-4941-ad9c-3612c49954ad tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:00.071450 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46905207-4565-4941-ad9c-3612c49954ad tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:00.071930 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46905207-4565-4941-ad9c-3612c49954ad tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:00.072366 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46905207-4565-4941-ad9c-3612c49954ad tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:00.073053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46905207-4565-4941-ad9c-3612c49954ad tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:00.074066 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46905207-4565-4941-ad9c-3612c49954ad tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:00.074494 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-46905207-4565-4941-ad9c-3612c49954ad tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:00.202792 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-46905207-4565-4941-ad9c-3612c49954ad tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:00.210455 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-46905207-4565-4941-ad9c-3612c49954ad tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1687 microversion: 2.1 time: 0.149944 Sep 04 16:20:00.211019 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 401/795] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:00 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1687 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:00.531760 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-51adf5ec-d10d-4ac6-b9c2-d5e430b48e2e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:00.532264 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-51adf5ec-d10d-4ac6-b9c2-d5e430b48e2e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:00.538175 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51adf5ec-d10d-4ac6-b9c2-d5e430b48e2e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:00.538648 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51adf5ec-d10d-4ac6-b9c2-d5e430b48e2e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:00.539077 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51adf5ec-d10d-4ac6-b9c2-d5e430b48e2e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:00.539752 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51adf5ec-d10d-4ac6-b9c2-d5e430b48e2e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:00.540196 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51adf5ec-d10d-4ac6-b9c2-d5e430b48e2e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:00.540610 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-51adf5ec-d10d-4ac6-b9c2-d5e430b48e2e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:00.675230 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-51adf5ec-d10d-4ac6-b9c2-d5e430b48e2e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:00.684064 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-51adf5ec-d10d-4ac6-b9c2-d5e430b48e2e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1569 microversion: 2.1 time: 0.155449 Sep 04 16:20:00.684640 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 402/796] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:00 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:00.689033 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1ec6f6aa-ff26-42b8-8b70-8a4a77787ca0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:00.689678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1ec6f6aa-ff26-42b8-8b70-8a4a77787ca0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:00.695366 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ec6f6aa-ff26-42b8-8b70-8a4a77787ca0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:00.695849 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ec6f6aa-ff26-42b8-8b70-8a4a77787ca0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:00.696285 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ec6f6aa-ff26-42b8-8b70-8a4a77787ca0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:00.697001 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ec6f6aa-ff26-42b8-8b70-8a4a77787ca0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:00.697461 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ec6f6aa-ff26-42b8-8b70-8a4a77787ca0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:00.697910 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1ec6f6aa-ff26-42b8-8b70-8a4a77787ca0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:00.848806 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1ec6f6aa-ff26-42b8-8b70-8a4a77787ca0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:00.858793 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1ec6f6aa-ff26-42b8-8b70-8a4a77787ca0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1578 microversion: 2.1 time: 0.173165 Sep 04 16:20:00.859637 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 403/797] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:00 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:01.094957 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-20a78410-b3ae-4801-ac7d-9d196f5f14c8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:01.095712 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-20a78410-b3ae-4801-ac7d-9d196f5f14c8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:01.105852 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20a78410-b3ae-4801-ac7d-9d196f5f14c8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:01.106028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20a78410-b3ae-4801-ac7d-9d196f5f14c8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:01.107171 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20a78410-b3ae-4801-ac7d-9d196f5f14c8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:01.107898 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20a78410-b3ae-4801-ac7d-9d196f5f14c8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:01.108354 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20a78410-b3ae-4801-ac7d-9d196f5f14c8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:01.108775 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-20a78410-b3ae-4801-ac7d-9d196f5f14c8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:01.134476 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-20a78410-b3ae-4801-ac7d-9d196f5f14c8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73/ips" status: 200 len: 151 microversion: 2.20 time: 0.047226 Sep 04 16:20:01.135065 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 404/798] 10.222.0.39 () {60 vars in 1289 bytes} [Sun Sep 4 16:20:01 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73/ips => generated 151 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 04 16:20:01.236786 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f9e152fc-0d5f-4385-b442-dd298444bfbe tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:01.237505 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f9e152fc-0d5f-4385-b442-dd298444bfbe tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:01.243887 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9e152fc-0d5f-4385-b442-dd298444bfbe tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:01.244447 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9e152fc-0d5f-4385-b442-dd298444bfbe tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:01.244955 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9e152fc-0d5f-4385-b442-dd298444bfbe tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:01.246439 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9e152fc-0d5f-4385-b442-dd298444bfbe tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:01.246898 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9e152fc-0d5f-4385-b442-dd298444bfbe tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:01.247324 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9e152fc-0d5f-4385-b442-dd298444bfbe tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:01.590500 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f9e152fc-0d5f-4385-b442-dd298444bfbe tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:01.598431 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f9e152fc-0d5f-4385-b442-dd298444bfbe tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1687 microversion: 2.1 time: 0.365824 Sep 04 16:20:01.599082 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 405/799] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:01 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1687 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:01.623220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e7eef457-9c23-4fef-a76b-dfad870a29b0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:20:01.626263 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e7eef457-9c23-4fef-a76b-dfad870a29b0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:01.626560 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-46987051-f5f8-4ada-8003-ae59aef35067 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "POST /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.684904 Sep 04 16:20:01.628228 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 395/800] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Sep 4 16:19:59 2022] POST /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df/os-volume_attachments => generated 194 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:20:01.640042 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7eef457-9c23-4fef-a76b-dfad870a29b0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:01.640532 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7eef457-9c23-4fef-a76b-dfad870a29b0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:01.641015 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7eef457-9c23-4fef-a76b-dfad870a29b0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:01.641762 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7eef457-9c23-4fef-a76b-dfad870a29b0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:01.642456 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7eef457-9c23-4fef-a76b-dfad870a29b0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:01.642879 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e7eef457-9c23-4fef-a76b-dfad870a29b0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:01.661803 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:20:01.709044 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-93736c86-8ee2-4ae8-993a-6d52466fa9f6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:01.710101 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-93736c86-8ee2-4ae8-993a-6d52466fa9f6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:01.719881 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-93736c86-8ee2-4ae8-993a-6d52466fa9f6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:01.720682 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-93736c86-8ee2-4ae8-993a-6d52466fa9f6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:01.721268 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-93736c86-8ee2-4ae8-993a-6d52466fa9f6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:01.722389 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-93736c86-8ee2-4ae8-993a-6d52466fa9f6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:01.723200 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-93736c86-8ee2-4ae8-993a-6d52466fa9f6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:01.723926 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-93736c86-8ee2-4ae8-993a-6d52466fa9f6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:01.882857 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e7eef457-9c23-4fef-a76b-dfad870a29b0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "POST /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6/action" status: 202 len: 0 microversion: 2.1 time: 0.258726 Sep 04 16:20:01.882857 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 406/801] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Sep 4 16:20:01 2022] POST /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 04 16:20:01.904056 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-daa15be4-23fb-43bb-ace5-b7d1498af0b8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:01.904056 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-daa15be4-23fb-43bb-ace5-b7d1498af0b8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:01.909856 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-daa15be4-23fb-43bb-ace5-b7d1498af0b8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:01.910351 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-daa15be4-23fb-43bb-ace5-b7d1498af0b8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:01.910790 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-daa15be4-23fb-43bb-ace5-b7d1498af0b8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:01.911487 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-daa15be4-23fb-43bb-ace5-b7d1498af0b8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:01.911943 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-daa15be4-23fb-43bb-ace5-b7d1498af0b8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:01.912394 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-daa15be4-23fb-43bb-ace5-b7d1498af0b8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:02.086094 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-93736c86-8ee2-4ae8-993a-6d52466fa9f6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:02.095166 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-93736c86-8ee2-4ae8-993a-6d52466fa9f6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1569 microversion: 2.1 time: 0.390806 Sep 04 16:20:02.096006 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 396/802] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:01 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1569 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:02.101187 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2ce34ac9-022f-4f26-b361-66fec8eba333 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:02.101951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2ce34ac9-022f-4f26-b361-66fec8eba333 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:02.108878 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2ce34ac9-022f-4f26-b361-66fec8eba333 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:02.113824 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2ce34ac9-022f-4f26-b361-66fec8eba333 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:02.113824 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2ce34ac9-022f-4f26-b361-66fec8eba333 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:02.113824 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2ce34ac9-022f-4f26-b361-66fec8eba333 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:02.113824 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2ce34ac9-022f-4f26-b361-66fec8eba333 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:02.114354 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2ce34ac9-022f-4f26-b361-66fec8eba333 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:02.115916 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:20:02.385623 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-daa15be4-23fb-43bb-ace5-b7d1498af0b8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:02.395220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-daa15be4-23fb-43bb-ace5-b7d1498af0b8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1578 microversion: 2.1 time: 0.507769 Sep 04 16:20:02.409832 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 407/803] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:01 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1578 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:02.574934 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2ce34ac9-022f-4f26-b361-66fec8eba333 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:02.583652 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2ce34ac9-022f-4f26-b361-66fec8eba333 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1752 microversion: 2.1 time: 0.486670 Sep 04 16:20:02.584405 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 397/804] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:02 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1752 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:02.623709 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0e595859-a1e6-418a-a727-6028f4b8a77a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:02.624317 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0e595859-a1e6-418a-a727-6028f4b8a77a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:02.630227 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e595859-a1e6-418a-a727-6028f4b8a77a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:02.630708 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e595859-a1e6-418a-a727-6028f4b8a77a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:02.631140 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e595859-a1e6-418a-a727-6028f4b8a77a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:02.631831 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e595859-a1e6-418a-a727-6028f4b8a77a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:02.632282 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e595859-a1e6-418a-a727-6028f4b8a77a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:02.632710 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0e595859-a1e6-418a-a727-6028f4b8a77a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:02.781649 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0e595859-a1e6-418a-a727-6028f4b8a77a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:02.789443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0e595859-a1e6-418a-a727-6028f4b8a77a tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1619 microversion: 2.1 time: 0.170414 Sep 04 16:20:02.801843 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 408/805] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:02 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1619 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:03.121394 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-20e80e35-bcd6-40a4-81e0-72f8cb516a44 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:03.122168 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-20e80e35-bcd6-40a4-81e0-72f8cb516a44 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:03.130474 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20e80e35-bcd6-40a4-81e0-72f8cb516a44 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:03.131085 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20e80e35-bcd6-40a4-81e0-72f8cb516a44 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:03.131523 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20e80e35-bcd6-40a4-81e0-72f8cb516a44 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:03.132232 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20e80e35-bcd6-40a4-81e0-72f8cb516a44 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:03.132685 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20e80e35-bcd6-40a4-81e0-72f8cb516a44 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:03.133140 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20e80e35-bcd6-40a4-81e0-72f8cb516a44 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:03.328858 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cd0652ba-6913-4365-8e81-9ea976d3efca tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:20:03.329286 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cd0652ba-6913-4365-8e81-9ea976d3efca tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:03.336498 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd0652ba-6913-4365-8e81-9ea976d3efca tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:03.336976 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd0652ba-6913-4365-8e81-9ea976d3efca tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:03.337409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd0652ba-6913-4365-8e81-9ea976d3efca tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:03.338131 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd0652ba-6913-4365-8e81-9ea976d3efca tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:03.338582 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd0652ba-6913-4365-8e81-9ea976d3efca tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:03.339176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd0652ba-6913-4365-8e81-9ea976d3efca tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:03.363823 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-cd0652ba-6913-4365-8e81-9ea976d3efca tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lazy-loading 'flavor' on Instance uuid ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:20:03.685660 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-20e80e35-bcd6-40a4-81e0-72f8cb516a44 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:03.699872 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-20e80e35-bcd6-40a4-81e0-72f8cb516a44 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1569 microversion: 2.1 time: 0.583363 Sep 04 16:20:03.702403 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 398/806] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:03 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1569 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:03.712710 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-66c4d2ea-33ec-458a-bf62-01a2ccd283a8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:03.713331 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-66c4d2ea-33ec-458a-bf62-01a2ccd283a8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:03.734122 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66c4d2ea-33ec-458a-bf62-01a2ccd283a8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:03.734624 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66c4d2ea-33ec-458a-bf62-01a2ccd283a8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:03.735064 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66c4d2ea-33ec-458a-bf62-01a2ccd283a8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:03.735773 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66c4d2ea-33ec-458a-bf62-01a2ccd283a8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:03.736246 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66c4d2ea-33ec-458a-bf62-01a2ccd283a8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:03.736659 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66c4d2ea-33ec-458a-bf62-01a2ccd283a8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:03.858948 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-66c4d2ea-33ec-458a-bf62-01a2ccd283a8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:03.868762 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-66c4d2ea-33ec-458a-bf62-01a2ccd283a8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1510 microversion: 2.1 time: 0.167189 Sep 04 16:20:03.869540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 399/807] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:03 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:03.875090 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-d6e42b5e-b6ef-41dd-98ea-5bfc51638de2 req-a3e2b7a1-dcb0-4593-996b-f4d6d8c53c1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0188e4a8-e601-43da-b389-7e0a8410ae8d", "name": "network-vif-deleted", "tag": "ab492967-90e3-4b09-b251-d08c6b91d22c"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:20:03.887298 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-d6e42b5e-b6ef-41dd-98ea-5bfc51638de2 req-a3e2b7a1-dcb0-4593-996b-f4d6d8c53c1f service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:03.888059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-d6e42b5e-b6ef-41dd-98ea-5bfc51638de2 req-a3e2b7a1-dcb0-4593-996b-f4d6d8c53c1f service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:03.888686 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-d6e42b5e-b6ef-41dd-98ea-5bfc51638de2 req-a3e2b7a1-dcb0-4593-996b-f4d6d8c53c1f service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:03.904972 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-d6e42b5e-b6ef-41dd-98ea-5bfc51638de2 req-a3e2b7a1-dcb0-4593-996b-f4d6d8c53c1f service nova] Creating event network-vif-deleted:ab492967-90e3-4b09-b251-d08c6b91d22c for instance 0188e4a8-e601-43da-b389-7e0a8410ae8d on hv-cinder-85236 Sep 04 16:20:03.910166 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-d6e42b5e-b6ef-41dd-98ea-5bfc51638de2 req-a3e2b7a1-dcb0-4593-996b-f4d6d8c53c1f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038461 Sep 04 16:20:03.914489 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 400/808] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:20:03.919925 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a2bbcc87-d2d1-4620-9ecc-b3a90284e53f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:03.923975 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a2bbcc87-d2d1-4620-9ecc-b3a90284e53f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:03.927345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a2bbcc87-d2d1-4620-9ecc-b3a90284e53f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:03.928032 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a2bbcc87-d2d1-4620-9ecc-b3a90284e53f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:03.928619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a2bbcc87-d2d1-4620-9ecc-b3a90284e53f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:03.929503 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a2bbcc87-d2d1-4620-9ecc-b3a90284e53f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:03.930127 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a2bbcc87-d2d1-4620-9ecc-b3a90284e53f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:03.930699 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a2bbcc87-d2d1-4620-9ecc-b3a90284e53f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:03.972240 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cd0652ba-6913-4365-8e81-9ea976d3efca tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "POST /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73/action" status: 202 len: 0 microversion: 2.20 time: 0.647338 Sep 04 16:20:03.973814 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 409/809] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Sep 4 16:20:03 2022] POST /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73/action => generated 0 bytes in 650 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 04 16:20:03.984239 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9176d9a7-ec86-457a-a744-0d100a78d0ca tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:03.986300 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9176d9a7-ec86-457a-a744-0d100a78d0ca tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:03.993763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9176d9a7-ec86-457a-a744-0d100a78d0ca tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:03.994520 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9176d9a7-ec86-457a-a744-0d100a78d0ca tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:03.996002 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9176d9a7-ec86-457a-a744-0d100a78d0ca tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:03.997323 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9176d9a7-ec86-457a-a744-0d100a78d0ca tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:03.998028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9176d9a7-ec86-457a-a744-0d100a78d0ca tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:03.998678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9176d9a7-ec86-457a-a744-0d100a78d0ca tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:04.060699 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9176d9a7-ec86-457a-a744-0d100a78d0ca tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:04.061935 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9176d9a7-ec86-457a-a744-0d100a78d0ca tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:04.062698 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9176d9a7-ec86-457a-a744-0d100a78d0ca tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:04.064051 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-9176d9a7-ec86-457a-a744-0d100a78d0ca tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lazy-loading 'fault' on Instance uuid 0188e4a8-e601-43da-b389-7e0a8410ae8d {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:20:04.124455 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-9176d9a7-ec86-457a-a744-0d100a78d0ca tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:04.139758 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9176d9a7-ec86-457a-a744-0d100a78d0ca tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1334 microversion: 2.1 time: 0.163592 Sep 04 16:20:04.140760 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 410/810] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:03 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1334 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:04.160704 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-324c1e7e-f5ef-41a2-b70f-5099ebd47231 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:04.169121 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-324c1e7e-f5ef-41a2-b70f-5099ebd47231 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:04.169290 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a2bbcc87-d2d1-4620-9ecc-b3a90284e53f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:04.177371 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a2bbcc87-d2d1-4620-9ecc-b3a90284e53f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1752 microversion: 2.1 time: 0.261575 Sep 04 16:20:04.178492 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-324c1e7e-f5ef-41a2-b70f-5099ebd47231 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:04.179529 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-324c1e7e-f5ef-41a2-b70f-5099ebd47231 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:04.181853 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 401/811] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:03 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1752 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:04.182051 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-324c1e7e-f5ef-41a2-b70f-5099ebd47231 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:04.183464 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-324c1e7e-f5ef-41a2-b70f-5099ebd47231 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:04.183925 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-324c1e7e-f5ef-41a2-b70f-5099ebd47231 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:04.184351 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-324c1e7e-f5ef-41a2-b70f-5099ebd47231 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:04.380309 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-324c1e7e-f5ef-41a2-b70f-5099ebd47231 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:04.391189 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-324c1e7e-f5ef-41a2-b70f-5099ebd47231 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:04.392645 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-324c1e7e-f5ef-41a2-b70f-5099ebd47231 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:04.393843 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-324c1e7e-f5ef-41a2-b70f-5099ebd47231 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1724 microversion: 2.20 time: 0.245050 Sep 04 16:20:04.402749 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 411/812] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:04 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:04.725848 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a530cc47-b63c-46a9-acaa-6a7d782d1e66 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:04.726457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a530cc47-b63c-46a9-acaa-6a7d782d1e66 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:04.732856 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a530cc47-b63c-46a9-acaa-6a7d782d1e66 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:04.733632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a530cc47-b63c-46a9-acaa-6a7d782d1e66 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:04.734266 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a530cc47-b63c-46a9-acaa-6a7d782d1e66 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:04.735235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a530cc47-b63c-46a9-acaa-6a7d782d1e66 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:04.735842 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a530cc47-b63c-46a9-acaa-6a7d782d1e66 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:04.736419 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a530cc47-b63c-46a9-acaa-6a7d782d1e66 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:04.899261 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d366db3e-6b08-4dd9-a8a2-751990dace8f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:04.899992 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d366db3e-6b08-4dd9-a8a2-751990dace8f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:04.907431 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a530cc47-b63c-46a9-acaa-6a7d782d1e66 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:04.913594 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d366db3e-6b08-4dd9-a8a2-751990dace8f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:04.914207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d366db3e-6b08-4dd9-a8a2-751990dace8f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:04.915253 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d366db3e-6b08-4dd9-a8a2-751990dace8f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:04.916649 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a530cc47-b63c-46a9-acaa-6a7d782d1e66 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1569 microversion: 2.1 time: 0.195083 Sep 04 16:20:04.917924 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 402/813] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:04 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:04.918685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d366db3e-6b08-4dd9-a8a2-751990dace8f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:04.919850 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d366db3e-6b08-4dd9-a8a2-751990dace8f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:04.920348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d366db3e-6b08-4dd9-a8a2-751990dace8f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:04.957523 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d366db3e-6b08-4dd9-a8a2-751990dace8f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:04.959986 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d366db3e-6b08-4dd9-a8a2-751990dace8f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:04.959986 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d366db3e-6b08-4dd9-a8a2-751990dace8f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:04.960371 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-d366db3e-6b08-4dd9-a8a2-751990dace8f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lazy-loading 'fault' on Instance uuid 5d24964d-b2cb-420a-9232-b5662800ec31 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:20:05.009467 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d366db3e-6b08-4dd9-a8a2-751990dace8f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:05.018537 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d366db3e-6b08-4dd9-a8a2-751990dace8f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 200 len: 1231 microversion: 2.1 time: 0.124091 Sep 04 16:20:05.019100 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 412/814] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:04 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 1231 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:05.176396 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-03b2c479-4a38-4d36-b9c7-7428dd11fe23 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:05.177016 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-03b2c479-4a38-4d36-b9c7-7428dd11fe23 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:05.183532 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03b2c479-4a38-4d36-b9c7-7428dd11fe23 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:05.184659 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03b2c479-4a38-4d36-b9c7-7428dd11fe23 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:05.185106 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03b2c479-4a38-4d36-b9c7-7428dd11fe23 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:05.185843 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03b2c479-4a38-4d36-b9c7-7428dd11fe23 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:05.186302 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03b2c479-4a38-4d36-b9c7-7428dd11fe23 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:05.186731 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03b2c479-4a38-4d36-b9c7-7428dd11fe23 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:05.200809 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-af11f119-5e7b-414f-9b11-b18c2c55d050 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:05.201763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-af11f119-5e7b-414f-9b11-b18c2c55d050 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:05.207399 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af11f119-5e7b-414f-9b11-b18c2c55d050 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:05.207911 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af11f119-5e7b-414f-9b11-b18c2c55d050 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:05.208353 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af11f119-5e7b-414f-9b11-b18c2c55d050 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:05.209049 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af11f119-5e7b-414f-9b11-b18c2c55d050 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:05.209505 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af11f119-5e7b-414f-9b11-b18c2c55d050 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:05.209960 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-af11f119-5e7b-414f-9b11-b18c2c55d050 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:05.222805 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03b2c479-4a38-4d36-b9c7-7428dd11fe23 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:05.223391 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03b2c479-4a38-4d36-b9c7-7428dd11fe23 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:05.223903 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-03b2c479-4a38-4d36-b9c7-7428dd11fe23 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:05.224422 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-03b2c479-4a38-4d36-b9c7-7428dd11fe23 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lazy-loading 'fault' on Instance uuid 0188e4a8-e601-43da-b389-7e0a8410ae8d {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:20:05.271765 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-03b2c479-4a38-4d36-b9c7-7428dd11fe23 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:05.279324 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-03b2c479-4a38-4d36-b9c7-7428dd11fe23 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 200 len: 1334 microversion: 2.1 time: 0.106887 Sep 04 16:20:05.279900 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 403/815] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:05 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 1334 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:05.368974 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-af11f119-5e7b-414f-9b11-b18c2c55d050 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:05.377894 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-af11f119-5e7b-414f-9b11-b18c2c55d050 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1757 microversion: 2.1 time: 0.180959 Sep 04 16:20:05.378471 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 413/816] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:05 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:05.419930 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b0746abe-2201-4667-99f6-fc5eae09edcc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:05.420532 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b0746abe-2201-4667-99f6-fc5eae09edcc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:05.426602 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0746abe-2201-4667-99f6-fc5eae09edcc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:05.427099 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0746abe-2201-4667-99f6-fc5eae09edcc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:05.427532 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0746abe-2201-4667-99f6-fc5eae09edcc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:05.428226 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0746abe-2201-4667-99f6-fc5eae09edcc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:05.428682 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0746abe-2201-4667-99f6-fc5eae09edcc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:05.429142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0746abe-2201-4667-99f6-fc5eae09edcc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:05.560213 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b0746abe-2201-4667-99f6-fc5eae09edcc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:05.570034 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b0746abe-2201-4667-99f6-fc5eae09edcc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:05.571505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b0746abe-2201-4667-99f6-fc5eae09edcc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:05.572676 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b0746abe-2201-4667-99f6-fc5eae09edcc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1724 microversion: 2.20 time: 0.156781 Sep 04 16:20:05.573250 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 404/817] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:05 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:05.925587 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-75f090b4-682c-46ac-b14a-31e9060357ca req-bc171aed-7a46-49b9-bdde-6cb98cf7f6ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d24964d-b2cb-420a-9232-b5662800ec31", "name": "network-vif-deleted", "tag": "16088940-01d4-4b7c-9350-5157b311afa1"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:20:05.935550 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-75f090b4-682c-46ac-b14a-31e9060357ca req-bc171aed-7a46-49b9-bdde-6cb98cf7f6ca service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:05.935963 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-75f090b4-682c-46ac-b14a-31e9060357ca req-bc171aed-7a46-49b9-bdde-6cb98cf7f6ca service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:05.936387 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-75f090b4-682c-46ac-b14a-31e9060357ca req-bc171aed-7a46-49b9-bdde-6cb98cf7f6ca service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:05.942006 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1b26b36e-7025-4c2d-9d39-a3fd9f666af8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:05.942561 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1b26b36e-7025-4c2d-9d39-a3fd9f666af8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:05.947824 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-75f090b4-682c-46ac-b14a-31e9060357ca req-bc171aed-7a46-49b9-bdde-6cb98cf7f6ca service nova] Creating event network-vif-deleted:16088940-01d4-4b7c-9350-5157b311afa1 for instance 5d24964d-b2cb-420a-9232-b5662800ec31 on hv-cinder-85236 Sep 04 16:20:05.948706 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b26b36e-7025-4c2d-9d39-a3fd9f666af8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:05.949189 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b26b36e-7025-4c2d-9d39-a3fd9f666af8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:05.950248 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b26b36e-7025-4c2d-9d39-a3fd9f666af8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:05.950473 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b26b36e-7025-4c2d-9d39-a3fd9f666af8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:05.950921 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b26b36e-7025-4c2d-9d39-a3fd9f666af8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:05.951338 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1b26b36e-7025-4c2d-9d39-a3fd9f666af8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:05.952857 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-75f090b4-682c-46ac-b14a-31e9060357ca req-bc171aed-7a46-49b9-bdde-6cb98cf7f6ca service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030896 Sep 04 16:20:05.953713 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 414/818] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:20:06.042497 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e9356ac2-0156-4f6c-b5ce-86fc797127a1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:06.043197 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e9356ac2-0156-4f6c-b5ce-86fc797127a1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:06.049973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9356ac2-0156-4f6c-b5ce-86fc797127a1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:06.050479 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9356ac2-0156-4f6c-b5ce-86fc797127a1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:06.050897 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9356ac2-0156-4f6c-b5ce-86fc797127a1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:06.051595 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9356ac2-0156-4f6c-b5ce-86fc797127a1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:06.052050 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9356ac2-0156-4f6c-b5ce-86fc797127a1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:06.052480 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e9356ac2-0156-4f6c-b5ce-86fc797127a1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:06.069634 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-e9356ac2-0156-4f6c-b5ce-86fc797127a1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] HTTP exception thrown: Instance 5d24964d-b2cb-420a-9232-b5662800ec31 could not be found. Sep 04 16:20:06.071315 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e9356ac2-0156-4f6c-b5ce-86fc797127a1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Request method failure captured: Sep 04 16:20:06.071315 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 HTTP/1.1 Sep 04 16:20:06.071315 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:20:06.071315 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:20:06.071315 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:20:06.071315 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 04 16:20:06.071315 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:20:06.071315 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:20:06.071315 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:20:06.071315 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:20:06.071315 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFM8uS7tmOamqPvKNpmBByHHyO3JB88cursd2e2cdQuKNX05bhAE2YlCmcgCuF-D93U9FZ1j0Oklos-aDTy2xmeVtiyjYREMpuzPrVdQ5D8rXeGiVWYGibDg5as-87Ptbd_DwsfNngL4M1u7mMzM5-NE3blKYZ8EUI53K_ZjGpMt4TSs Sep 04 16:20:06.071315 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:20:06.071315 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:20:06.071315 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:20:06.071315 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:20:06.071315 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:20:06.071315 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:20:06.071315 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: 56e82ba24a474557af758826743136d9 Sep 04 16:20:06.071315 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-TestVolumeBootPattern-2134566845 Sep 04 16:20:06.071315 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:20:06.071315 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:20:06.072844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/56e82ba24a474557af758826743136d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/56e82ba24a474557af758826743136d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_56e82ba24a474557af758826743136d9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/56e82ba24a474557af758826743136d9"}]}] Sep 04 16:20:06.072844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-TestVolumeBootPattern-2134566845 Sep 04 16:20:06.072844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: 56e82ba24a474557af758826743136d9 Sep 04 16:20:06.072844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestVolumeBootPattern-2134566845 Sep 04 16:20:06.072844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-TestVolumeBootPattern-2134566845-project Sep 04 16:20:06.072844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:20:06.072844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:20:06.072844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: b694f1163ef54b82b86e06bf825c57e4 Sep 04 16:20:06.072844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-TestVolumeBootPattern-2134566845-project Sep 04 16:20:06.072844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: > Sep 04 16:20:06.072844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Instance 5d24964d-b2cb-420a-9232-b5662800ec31 could not be found. Sep 04 16:20:06.072844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'id': '5d24964d-b2cb-420a-9232-b5662800ec31'} Sep 04 16:20:06.074005 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:20:06.074005 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:20:06.074005 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:20:06.074005 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:20:06.074005 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:20:06.074005 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:20:06.074005 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:20:06.074005 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:20:06.074005 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:20:06.074005 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:20:06.074005 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d24964d-b2cb-420a-9232-b5662800ec31 could not be found. Sep 04 16:20:06.074005 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:20:06.074005 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:20:06.074005 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:20:06.074005 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:20:06.074005 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:20:06.074005 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:20:06.074005 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:20:06.074005 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:20:06.074005 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:20:06.075485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:20:06.075485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:20:06.075485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:20:06.075485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:20:06.075485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:20:06.075485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:20:06.075485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:20:06.075485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d24964d-b2cb-420a-9232-b5662800ec31 could not be found. Sep 04 16:20:06.075485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:20:06.075485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:20:06.075485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:20:06.075485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:20:06.075485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:20:06.075485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:20:06.075485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:20:06.075485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:20:06.075485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d24964d-b2cb-420a-9232-b5662800ec31 could not be found. Sep 04 16:20:06.075485 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:20:06.076598 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e9356ac2-0156-4f6c-b5ce-86fc797127a1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Returning 404 to user: Instance 5d24964d-b2cb-420a-9232-b5662800ec31 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:20:06.076598 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e9356ac2-0156-4f6c-b5ce-86fc797127a1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 404 len: 111 microversion: 2.1 time: 0.034668 Sep 04 16:20:06.076598 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 415/819] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:06 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:20:06.087907 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1b26b36e-7025-4c2d-9d39-a3fd9f666af8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:06.107911 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1b26b36e-7025-4c2d-9d39-a3fd9f666af8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1569 microversion: 2.1 time: 0.169745 Sep 04 16:20:06.116859 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 405/820] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:05 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:06.175505 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3b45b8d0-a606-47e4-87a0-1c08d406a880 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-209775162", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2049353985", "security_groups": [{"name": "tempest-secgroup-smoke-2145735453"}], "block_device_mapping_v2": [{"uuid": "5d2bda1a-fd92-4f45-a833-57ed8ab7a4c0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2405227e-d5b0-44f1-b814-62bb7f0eb040"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:20:06.290580 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-3b45b8d0-a606-47e4-87a0-1c08d406a880 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] validate_networks() for [('2405227e-d5b0-44f1-b814-62bb7f0eb040', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 16:20:06.303070 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d6f01e7d-55df-4d2e-9720-691a3ad64274 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:06.303780 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d6f01e7d-55df-4d2e-9720-691a3ad64274 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 0188e4a8-e601-43da-b389-7e0a8410ae8d] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:06.310895 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d6f01e7d-55df-4d2e-9720-691a3ad64274 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:06.311461 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d6f01e7d-55df-4d2e-9720-691a3ad64274 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:06.311998 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d6f01e7d-55df-4d2e-9720-691a3ad64274 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:06.312804 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d6f01e7d-55df-4d2e-9720-691a3ad64274 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:06.313329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d6f01e7d-55df-4d2e-9720-691a3ad64274 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:06.313861 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d6f01e7d-55df-4d2e-9720-691a3ad64274 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:06.328846 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-d6f01e7d-55df-4d2e-9720-691a3ad64274 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] HTTP exception thrown: Instance 0188e4a8-e601-43da-b389-7e0a8410ae8d could not be found. Sep 04 16:20:06.330632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d6f01e7d-55df-4d2e-9720-691a3ad64274 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Request method failure captured: Sep 04 16:20:06.330632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d HTTP/1.1 Sep 04 16:20:06.330632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:20:06.330632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:20:06.330632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:20:06.330632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:20:06.330632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:20:06.330632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:20:06.330632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:20:06.330632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:20:06.330632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFM7AQu8qea0BFPhZJJD1SjpMjCb9OT3yqcZNamIbdv_2tiOBslm23HUMyFLRuEja9zOxHSb7HCyTIWbzZ5oqcjUZcQ0rElKr7qovko9hAD8HBN652TVbu8E6ygcWWlMFsAALAQQiHxyfrlUQj8PuQ9eIFVlDfwklsO4cKSYRuTyg9y4 Sep 04 16:20:06.330632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:20:06.330632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:20:06.330632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:20:06.330632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:20:06.330632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:20:06.330632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:20:06.330632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: cb043a0ecad3466bbd5a5874126d2810 Sep 04 16:20:06.330632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1718450479 Sep 04 16:20:06.330632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:20:06.330632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:20:06.332042 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cb043a0ecad3466bbd5a5874126d2810"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb043a0ecad3466bbd5a5874126d2810"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cb043a0ecad3466bbd5a5874126d2810", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb043a0ecad3466bbd5a5874126d2810"}]}] Sep 04 16:20:06.332042 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1718450479 Sep 04 16:20:06.332042 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: cb043a0ecad3466bbd5a5874126d2810 Sep 04 16:20:06.332042 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1718450479 Sep 04 16:20:06.332042 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-ServerRescueNegativeTestJSON-1718450479-project Sep 04 16:20:06.332042 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:20:06.332042 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:20:06.332042 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: a9d55c52717546b09d93d956a29f49a9 Sep 04 16:20:06.332042 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1718450479-project Sep 04 16:20:06.332042 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: > Sep 04 16:20:06.332042 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Instance 0188e4a8-e601-43da-b389-7e0a8410ae8d could not be found. Sep 04 16:20:06.332042 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': '0188e4a8-e601-43da-b389-7e0a8410ae8d'} Sep 04 16:20:06.332777 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:20:06.332777 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:20:06.332777 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:20:06.332777 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:20:06.332777 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:20:06.332777 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:20:06.332777 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:20:06.332777 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:20:06.332777 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:20:06.332777 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:20:06.332777 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0188e4a8-e601-43da-b389-7e0a8410ae8d could not be found. Sep 04 16:20:06.332777 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:20:06.332777 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:20:06.332777 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:20:06.332777 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:20:06.332777 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:20:06.332777 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:20:06.332777 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:20:06.332777 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:20:06.332777 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:20:06.334161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:20:06.334161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:20:06.334161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:20:06.334161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:20:06.334161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:20:06.334161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:20:06.334161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:20:06.334161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0188e4a8-e601-43da-b389-7e0a8410ae8d could not be found. Sep 04 16:20:06.334161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:20:06.334161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:20:06.334161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:20:06.334161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:20:06.334161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:20:06.334161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:20:06.334161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:20:06.334161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:20:06.334161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0188e4a8-e601-43da-b389-7e0a8410ae8d could not be found. Sep 04 16:20:06.334161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:20:06.335222 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d6f01e7d-55df-4d2e-9720-691a3ad64274 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Returning 404 to user: Instance 0188e4a8-e601-43da-b389-7e0a8410ae8d could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:20:06.335222 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d6f01e7d-55df-4d2e-9720-691a3ad64274 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d" status: 404 len: 111 microversion: 2.1 time: 0.033245 Sep 04 16:20:06.335222 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 406/821] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:06 2022] GET /compute/v2.1/servers/0188e4a8-e601-43da-b389-7e0a8410ae8d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 04 16:20:06.340879 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2fa1a09e-3cf2-4b92-b1e7-056d757bc4d1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '.version_select at 0x7f968904d820>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:06.430571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2fa1a09e-3cf2-4b92-b1e7-056d757bc4d1 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-11298293" status: 202 len: 0 microversion: 2.1 time: 0.093386 Sep 04 16:20:06.431178 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 407/822] 10.222.0.39 () {58 vars in 1215 bytes} [Sun Sep 4 16:20:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-11298293 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 04 16:20:06.440270 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-620b06aa-cc31-44b6-9a87-f70bf82886b8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:06.440270 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-620b06aa-cc31-44b6-9a87-f70bf82886b8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:06.443913 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-620b06aa-cc31-44b6-9a87-f70bf82886b8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:06.444482 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-620b06aa-cc31-44b6-9a87-f70bf82886b8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:06.445009 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-620b06aa-cc31-44b6-9a87-f70bf82886b8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:06.445819 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-620b06aa-cc31-44b6-9a87-f70bf82886b8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:06.446337 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-620b06aa-cc31-44b6-9a87-f70bf82886b8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:06.446835 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-620b06aa-cc31-44b6-9a87-f70bf82886b8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:06.658068 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-620b06aa-cc31-44b6-9a87-f70bf82886b8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:06.670294 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-620b06aa-cc31-44b6-9a87-f70bf82886b8 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1757 microversion: 2.1 time: 0.238045 Sep 04 16:20:06.685643 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 408/823] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:06 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1757 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:06.690866 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ff431bad-cf9b-4f60-8c1e-bb6cc653cb79 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:06.692513 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ff431bad-cf9b-4f60-8c1e-bb6cc653cb79 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:06.698492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff431bad-cf9b-4f60-8c1e-bb6cc653cb79 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:06.699002 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff431bad-cf9b-4f60-8c1e-bb6cc653cb79 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:06.699958 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff431bad-cf9b-4f60-8c1e-bb6cc653cb79 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:06.701281 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff431bad-cf9b-4f60-8c1e-bb6cc653cb79 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:06.701706 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff431bad-cf9b-4f60-8c1e-bb6cc653cb79 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:06.702142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ff431bad-cf9b-4f60-8c1e-bb6cc653cb79 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:06.993289 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3b45b8d0-a606-47e4-87a0-1c08d406a880 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 16:20:06.993758 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3b45b8d0-a606-47e4-87a0-1c08d406a880 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 16:20:06.994237 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3b45b8d0-a606-47e4-87a0-1c08d406a880 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 16:20:06.994646 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3b45b8d0-a606-47e4-87a0-1c08d406a880 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 16:20:06.995058 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-3b45b8d0-a606-47e4-87a0-1c08d406a880 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 16:20:07.004856 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b45b8d0-a606-47e4-87a0-1c08d406a880 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:07.005525 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b45b8d0-a606-47e4-87a0-1c08d406a880 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:07.005990 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b45b8d0-a606-47e4-87a0-1c08d406a880 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:07.006724 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b45b8d0-a606-47e4-87a0-1c08d406a880 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:07.007183 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b45b8d0-a606-47e4-87a0-1c08d406a880 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:07.007609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3b45b8d0-a606-47e4-87a0-1c08d406a880 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:07.017405 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ff431bad-cf9b-4f60-8c1e-bb6cc653cb79 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:07.026934 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-3b45b8d0-a606-47e4-87a0-1c08d406a880 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Getting quotas for project 56e82ba24a474557af758826743136d9. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:20:07.029511 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ff431bad-cf9b-4f60-8c1e-bb6cc653cb79 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:07.031567 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-3b45b8d0-a606-47e4-87a0-1c08d406a880 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Getting quotas for user b694f1163ef54b82b86e06bf825c57e4 and project 56e82ba24a474557af758826743136d9. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:20:07.032041 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ff431bad-cf9b-4f60-8c1e-bb6cc653cb79 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:07.033881 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ff431bad-cf9b-4f60-8c1e-bb6cc653cb79 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1724 microversion: 2.20 time: 0.349905 Sep 04 16:20:07.034676 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 409/824] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:06 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1724 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:07.091753 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3b45b8d0-a606-47e4-87a0-1c08d406a880 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 16:20:07.093917 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3b45b8d0-a606-47e4-87a0-1c08d406a880 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5d2bda1a-fd92-4f45-a833-57ed8ab7a4c0',volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 16:20:07.131349 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-17868ee3-33e5-4790-81a9-6210b063fb8d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:07.131665 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-17868ee3-33e5-4790-81a9-6210b063fb8d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:07.138035 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-17868ee3-33e5-4790-81a9-6210b063fb8d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:07.138513 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-17868ee3-33e5-4790-81a9-6210b063fb8d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:07.144113 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-17868ee3-33e5-4790-81a9-6210b063fb8d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:07.144113 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-17868ee3-33e5-4790-81a9-6210b063fb8d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:07.144113 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-17868ee3-33e5-4790-81a9-6210b063fb8d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:07.144113 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-17868ee3-33e5-4790-81a9-6210b063fb8d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:07.281327 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-17868ee3-33e5-4790-81a9-6210b063fb8d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:07.289438 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-17868ee3-33e5-4790-81a9-6210b063fb8d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1569 microversion: 2.1 time: 0.162258 Sep 04 16:20:07.290098 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 410/825] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:07 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:07.585105 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3b45b8d0-a606-47e4-87a0-1c08d406a880 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.413412 Sep 04 16:20:07.585973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 416/826] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Sep 4 16:20:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1415 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 16:20:07.601430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3343fa40-7dd6-43bb-abf4-7549bd9931fc tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:07.602414 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3343fa40-7dd6-43bb-abf4-7549bd9931fc tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:07.661169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3343fa40-7dd6-43bb-abf4-7549bd9931fc tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:07.668335 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3343fa40-7dd6-43bb-abf4-7549bd9931fc tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1094 microversion: 2.1 time: 0.072622 Sep 04 16:20:07.670847 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 411/827] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:07 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:07.693676 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-904bf96b-041b-435b-a389-0a02794b2d6e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:07.694293 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-904bf96b-041b-435b-a389-0a02794b2d6e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:07.700489 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-904bf96b-041b-435b-a389-0a02794b2d6e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:07.700968 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-904bf96b-041b-435b-a389-0a02794b2d6e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:07.701433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-904bf96b-041b-435b-a389-0a02794b2d6e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:07.702164 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-904bf96b-041b-435b-a389-0a02794b2d6e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:07.702710 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-904bf96b-041b-435b-a389-0a02794b2d6e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:07.703111 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-904bf96b-041b-435b-a389-0a02794b2d6e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:07.851034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-904bf96b-041b-435b-a389-0a02794b2d6e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:07.860707 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-904bf96b-041b-435b-a389-0a02794b2d6e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1757 microversion: 2.1 time: 0.170894 Sep 04 16:20:07.861287 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 417/828] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:07 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:08.060874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c4882ff9-8c6e-479e-a5f7-d3bbd4561773 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:08.061478 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c4882ff9-8c6e-479e-a5f7-d3bbd4561773 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:08.067396 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c4882ff9-8c6e-479e-a5f7-d3bbd4561773 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:08.067878 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c4882ff9-8c6e-479e-a5f7-d3bbd4561773 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:08.068311 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c4882ff9-8c6e-479e-a5f7-d3bbd4561773 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:08.069024 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c4882ff9-8c6e-479e-a5f7-d3bbd4561773 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:08.069470 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c4882ff9-8c6e-479e-a5f7-d3bbd4561773 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:08.069920 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c4882ff9-8c6e-479e-a5f7-d3bbd4561773 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:08.211354 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c4882ff9-8c6e-479e-a5f7-d3bbd4561773 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:08.221107 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c4882ff9-8c6e-479e-a5f7-d3bbd4561773 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:08.222615 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c4882ff9-8c6e-479e-a5f7-d3bbd4561773 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:08.223798 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c4882ff9-8c6e-479e-a5f7-d3bbd4561773 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1724 microversion: 2.20 time: 0.167439 Sep 04 16:20:08.224469 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 412/829] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:08 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:08.313068 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e5cf7706-a60b-428c-b985-6b608dd682fb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:08.313915 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e5cf7706-a60b-428c-b985-6b608dd682fb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:08.323331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5cf7706-a60b-428c-b985-6b608dd682fb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:08.328111 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5cf7706-a60b-428c-b985-6b608dd682fb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:08.328111 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5cf7706-a60b-428c-b985-6b608dd682fb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:08.328111 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5cf7706-a60b-428c-b985-6b608dd682fb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:08.328111 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5cf7706-a60b-428c-b985-6b608dd682fb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:08.328451 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5cf7706-a60b-428c-b985-6b608dd682fb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:08.462459 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e5cf7706-a60b-428c-b985-6b608dd682fb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:08.471253 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e5cf7706-a60b-428c-b985-6b608dd682fb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1569 microversion: 2.1 time: 0.162666 Sep 04 16:20:08.471827 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 418/830] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:08 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:08.695146 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0d56449e-1c6c-49dd-92cc-322139fd3676 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:08.696126 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0d56449e-1c6c-49dd-92cc-322139fd3676 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:08.705533 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0d56449e-1c6c-49dd-92cc-322139fd3676 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:08.706277 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0d56449e-1c6c-49dd-92cc-322139fd3676 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:08.709509 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0d56449e-1c6c-49dd-92cc-322139fd3676 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:08.709509 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0d56449e-1c6c-49dd-92cc-322139fd3676 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:08.709509 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0d56449e-1c6c-49dd-92cc-322139fd3676 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:08.709509 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0d56449e-1c6c-49dd-92cc-322139fd3676 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:08.775661 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0d56449e-1c6c-49dd-92cc-322139fd3676 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:08.783905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0d56449e-1c6c-49dd-92cc-322139fd3676 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1144 microversion: 2.1 time: 0.096732 Sep 04 16:20:08.784466 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 413/831] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:08 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1144 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:08.884160 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2305595a-e546-468e-a5d5-e3f7235f0cce tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:08.885051 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2305595a-e546-468e-a5d5-e3f7235f0cce tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:08.891967 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2305595a-e546-468e-a5d5-e3f7235f0cce tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:08.892759 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2305595a-e546-468e-a5d5-e3f7235f0cce tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:08.892882 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2305595a-e546-468e-a5d5-e3f7235f0cce tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:08.900334 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2305595a-e546-468e-a5d5-e3f7235f0cce tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:08.900334 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2305595a-e546-468e-a5d5-e3f7235f0cce tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:08.900334 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2305595a-e546-468e-a5d5-e3f7235f0cce tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:09.044193 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2305595a-e546-468e-a5d5-e3f7235f0cce tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:09.052766 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2305595a-e546-468e-a5d5-e3f7235f0cce tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1757 microversion: 2.1 time: 0.172338 Sep 04 16:20:09.053334 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 419/832] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:08 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:09.250956 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-66340e6f-4b70-413f-970d-df7f32861af3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:09.251565 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-66340e6f-4b70-413f-970d-df7f32861af3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:09.257746 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66340e6f-4b70-413f-970d-df7f32861af3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:09.258232 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66340e6f-4b70-413f-970d-df7f32861af3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:09.258668 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66340e6f-4b70-413f-970d-df7f32861af3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:09.259358 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66340e6f-4b70-413f-970d-df7f32861af3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:09.259807 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66340e6f-4b70-413f-970d-df7f32861af3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:09.260315 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66340e6f-4b70-413f-970d-df7f32861af3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:09.283716 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6e46a7f0-4e32-469b-826c-f7eb3adb998c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78d5260a-7670-4216-a149-eca97dcee6a2"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:20:09.286118 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6e46a7f0-4e32-469b-826c-f7eb3adb998c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:09.292126 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e46a7f0-4e32-469b-826c-f7eb3adb998c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:09.292607 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e46a7f0-4e32-469b-826c-f7eb3adb998c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:09.293110 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e46a7f0-4e32-469b-826c-f7eb3adb998c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:09.294159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e46a7f0-4e32-469b-826c-f7eb3adb998c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:09.295050 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e46a7f0-4e32-469b-826c-f7eb3adb998c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:09.295477 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6e46a7f0-4e32-469b-826c-f7eb3adb998c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:09.384213 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-6e46a7f0-4e32-469b-826c-f7eb3adb998c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] HTTP exception thrown: Invalid volume: volume 78d5260a-7670-4216-a149-eca97dcee6a2 is already attached to instances: 9e5636f2-5f2f-45ca-af8a-d998079502df Sep 04 16:20:09.385887 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6e46a7f0-4e32-469b-826c-f7eb3adb998c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Request method failure captured: Sep 04 16:20:09.385887 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: POST /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df/os-volume_attachments HTTP/1.1 Sep 04 16:20:09.385887 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:20:09.385887 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:20:09.385887 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:20:09.385887 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 74 Sep 04 16:20:09.385887 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:20:09.385887 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:20:09.385887 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:20:09.385887 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:20:09.385887 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFM7CEjNpb-xR3hPJMPQ-wsTXSagT7BYEktfOgtljHhzvAeE20V1mpt42r1aF9sMAbjmPPVeaP94mwlrfyovEVPw6ArC_YpgCrCSBFtvcpj7IAtQcwG53eIdKr17VLDw7eStXYQicK9SnKgixnRa-ofn7JvVLgTmHvsJ-_KcGiq48xm4 Sep 04 16:20:09.385887 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:20:09.385887 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:20:09.385887 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:20:09.385887 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:20:09.385887 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:20:09.385887 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:20:09.385887 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:20:09.385887 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:20:09.385887 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:20:09.385887 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:20:09.387573 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1cc5ea4158344d5c8a35bc5783410620", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}] Sep 04 16:20:09.387573 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:20:09.387573 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:20:09.387573 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:20:09.387573 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:20:09.387573 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:20:09.387573 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:20:09.387573 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: 6e5c22b631df4600b9f920120b67fc67 Sep 04 16:20:09.387573 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:20:09.387573 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Sep 04 16:20:09.387573 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {"volumeAttachment": {"volumeId": "78d5260a-7670-4216-a149-eca97dcee6a2"}} Sep 04 16:20:09.387573 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: > Sep 04 16:20:09.388609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Invalid volume: volume 78d5260a-7670-4216-a149-eca97dcee6a2 is already attached to instances: 9e5636f2-5f2f-45ca-af8a-d998079502df Sep 04 16:20:09.388609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'server_id': '9e5636f2-5f2f-45ca-af8a-d998079502df', 'body': {'volumeAttachment': {'volumeId': '78d5260a-7670-4216-a149-eca97dcee6a2'}}} Sep 04 16:20:09.388609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:20:09.388609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:20:09.388609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 04 16:20:09.388609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 04 16:20:09.388609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 04 16:20:09.388609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 04 16:20:09.388609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 04 16:20:09.388609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 04 16:20:09.388609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 04 16:20:09.388609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 04 16:20:09.388609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 04 16:20:09.388609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 04 16:20:09.388609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 78d5260a-7670-4216-a149-eca97dcee6a2 is already attached to instances: 9e5636f2-5f2f-45ca-af8a-d998079502df Sep 04 16:20:09.388609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:20:09.388609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:20:09.388609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:20:09.388609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:20:09.390007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:20:09.390007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:20:09.390007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:20:09.390007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:20:09.390007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:20:09.390007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:20:09.390007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 04 16:20:09.390007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 04 16:20:09.390007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 04 16:20:09.390007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 04 16:20:09.390007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 04 16:20:09.390007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 04 16:20:09.390007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 04 16:20:09.390007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 04 16:20:09.390007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 78d5260a-7670-4216-a149-eca97dcee6a2 is already attached to instances: 9e5636f2-5f2f-45ca-af8a-d998079502df Sep 04 16:20:09.390007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:20:09.390007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:20:09.390007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:20:09.390007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:20:09.390007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:20:09.391951 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:20:09.391951 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:20:09.391951 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:20:09.391951 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 78d5260a-7670-4216-a149-eca97dcee6a2 is already attached to instances: 9e5636f2-5f2f-45ca-af8a-d998079502df Sep 04 16:20:09.391951 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:20:09.391951 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6e46a7f0-4e32-469b-826c-f7eb3adb998c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Returning 400 to user: Invalid volume: volume 78d5260a-7670-4216-a149-eca97dcee6a2 is already attached to instances: 9e5636f2-5f2f-45ca-af8a-d998079502df {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:20:09.391951 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6e46a7f0-4e32-469b-826c-f7eb3adb998c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "POST /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107603 Sep 04 16:20:09.391951 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 420/833] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Sep 4 16:20:09 2022] POST /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 04 16:20:09.409656 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-66340e6f-4b70-413f-970d-df7f32861af3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:09.421004 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-66340e6f-4b70-413f-970d-df7f32861af3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:09.423780 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-66340e6f-4b70-413f-970d-df7f32861af3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:09.425509 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-66340e6f-4b70-413f-970d-df7f32861af3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1724 microversion: 2.20 time: 0.179070 Sep 04 16:20:09.426303 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 414/834] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:09 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:20:09.495226 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7895df73-f7a7-4bbc-83e3-b13c173ab823 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:09.495836 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7895df73-f7a7-4bbc-83e3-b13c173ab823 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:09.507611 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7895df73-f7a7-4bbc-83e3-b13c173ab823 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:09.508179 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7895df73-f7a7-4bbc-83e3-b13c173ab823 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:09.508844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7895df73-f7a7-4bbc-83e3-b13c173ab823 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:09.509598 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7895df73-f7a7-4bbc-83e3-b13c173ab823 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:09.510146 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7895df73-f7a7-4bbc-83e3-b13c173ab823 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:09.510676 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7895df73-f7a7-4bbc-83e3-b13c173ab823 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:09.516969 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:20:09.617396 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a3164055-3cc2-4a16-98be-94274685a2c1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:09.617999 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a3164055-3cc2-4a16-98be-94274685a2c1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:09.625598 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a3164055-3cc2-4a16-98be-94274685a2c1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:09.626316 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a3164055-3cc2-4a16-98be-94274685a2c1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:09.626758 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a3164055-3cc2-4a16-98be-94274685a2c1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:09.627462 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a3164055-3cc2-4a16-98be-94274685a2c1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:09.627927 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a3164055-3cc2-4a16-98be-94274685a2c1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:09.628440 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a3164055-3cc2-4a16-98be-94274685a2c1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:09.667552 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7895df73-f7a7-4bbc-83e3-b13c173ab823 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:09.676418 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7895df73-f7a7-4bbc-83e3-b13c173ab823 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1569 microversion: 2.1 time: 0.184905 Sep 04 16:20:09.677011 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 421/835] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:09 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:09.717404 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-a3164055-3cc2-4a16-98be-94274685a2c1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lazy-loading 'services' on Instance uuid 9e5636f2-5f2f-45ca-af8a-d998079502df {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:20:09.806340 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-be576bbd-8ea0-47ee-af77-2c03943dbe80 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:09.806946 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-be576bbd-8ea0-47ee-af77-2c03943dbe80 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:09.815468 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be576bbd-8ea0-47ee-af77-2c03943dbe80 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:09.815948 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be576bbd-8ea0-47ee-af77-2c03943dbe80 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:09.816376 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be576bbd-8ea0-47ee-af77-2c03943dbe80 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:09.817060 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be576bbd-8ea0-47ee-af77-2c03943dbe80 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:09.817509 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be576bbd-8ea0-47ee-af77-2c03943dbe80 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:09.817956 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-be576bbd-8ea0-47ee-af77-2c03943dbe80 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:09.880158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-be576bbd-8ea0-47ee-af77-2c03943dbe80 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:09.889079 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-be576bbd-8ea0-47ee-af77-2c03943dbe80 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1192 microversion: 2.1 time: 0.085940 Sep 04 16:20:09.889660 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 422/836] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:09 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1192 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:09.964492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a3164055-3cc2-4a16-98be-94274685a2c1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df/os-volume_attachments/78d5260a-7670-4216-a149-eca97dcee6a2" status: 202 len: 0 microversion: 2.1 time: 0.346609 Sep 04 16:20:09.964492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 415/837] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Sep 4 16:20:09 2022] DELETE /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df/os-volume_attachments/78d5260a-7670-4216-a149-eca97dcee6a2 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:20:09.964770 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-008fa5e1-dea8-4c30-b579-9bccf5d70d99 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:09.964770 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-008fa5e1-dea8-4c30-b579-9bccf5d70d99 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:09.970492 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-008fa5e1-dea8-4c30-b579-9bccf5d70d99 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:09.971008 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-008fa5e1-dea8-4c30-b579-9bccf5d70d99 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:09.971763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-008fa5e1-dea8-4c30-b579-9bccf5d70d99 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:09.971907 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-69dca9b0-8b9d-4773-956e-02975f6b1241 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:09.972457 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-008fa5e1-dea8-4c30-b579-9bccf5d70d99 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:09.972937 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-008fa5e1-dea8-4c30-b579-9bccf5d70d99 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:09.973356 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-008fa5e1-dea8-4c30-b579-9bccf5d70d99 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:09.974225 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-69dca9b0-8b9d-4773-956e-02975f6b1241 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:09.980576 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69dca9b0-8b9d-4773-956e-02975f6b1241 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:09.981092 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69dca9b0-8b9d-4773-956e-02975f6b1241 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:09.981529 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69dca9b0-8b9d-4773-956e-02975f6b1241 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:09.982345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69dca9b0-8b9d-4773-956e-02975f6b1241 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:09.982821 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69dca9b0-8b9d-4773-956e-02975f6b1241 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:09.983246 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-69dca9b0-8b9d-4773-956e-02975f6b1241 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:09.987151 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:20:09.999838 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-008fa5e1-dea8-4c30-b579-9bccf5d70d99 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 16:20:10.015567 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-69dca9b0-8b9d-4773-956e-02975f6b1241 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047764 Sep 04 16:20:10.016151 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 416/838] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:20:09 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:20:10.077805 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0c276a69-20cf-47c3-89bb-d346716638e0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:10.078453 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0c276a69-20cf-47c3-89bb-d346716638e0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:10.085180 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c276a69-20cf-47c3-89bb-d346716638e0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:10.085700 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c276a69-20cf-47c3-89bb-d346716638e0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:10.086148 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c276a69-20cf-47c3-89bb-d346716638e0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:10.086845 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c276a69-20cf-47c3-89bb-d346716638e0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:10.087293 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c276a69-20cf-47c3-89bb-d346716638e0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:10.087717 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0c276a69-20cf-47c3-89bb-d346716638e0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:10.361791 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-008fa5e1-dea8-4c30-b579-9bccf5d70d99 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 204 len: 0 microversion: 2.1 time: 0.404273 Sep 04 16:20:10.362473 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 423/839] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:20:09 2022] DELETE /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 16:20:10.370884 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-219cde92-8aef-4294-92db-9c1f61e705ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:10.371641 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-219cde92-8aef-4294-92db-9c1f61e705ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:10.378159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-219cde92-8aef-4294-92db-9c1f61e705ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:10.378640 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-219cde92-8aef-4294-92db-9c1f61e705ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:10.379074 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-219cde92-8aef-4294-92db-9c1f61e705ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:10.380218 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-219cde92-8aef-4294-92db-9c1f61e705ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:10.380321 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-219cde92-8aef-4294-92db-9c1f61e705ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:10.380672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-219cde92-8aef-4294-92db-9c1f61e705ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:10.390678 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0c276a69-20cf-47c3-89bb-d346716638e0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:10.400831 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0c276a69-20cf-47c3-89bb-d346716638e0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1757 microversion: 2.1 time: 0.328159 Sep 04 16:20:10.401410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 417/840] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:10 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1757 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:10.452516 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e37521ca-7391-494d-bc88-0498cbb6d668 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:10.453261 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e37521ca-7391-494d-bc88-0498cbb6d668 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:10.461194 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e37521ca-7391-494d-bc88-0498cbb6d668 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:10.461705 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e37521ca-7391-494d-bc88-0498cbb6d668 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:10.462138 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e37521ca-7391-494d-bc88-0498cbb6d668 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:10.463341 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e37521ca-7391-494d-bc88-0498cbb6d668 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:10.464124 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e37521ca-7391-494d-bc88-0498cbb6d668 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:10.464879 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e37521ca-7391-494d-bc88-0498cbb6d668 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:10.606036 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-219cde92-8aef-4294-92db-9c1f61e705ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:10.615010 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-219cde92-8aef-4294-92db-9c1f61e705ab tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1506 microversion: 2.1 time: 0.248304 Sep 04 16:20:10.615737 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 424/841] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:10 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:10.699754 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3e55e9a9-4e78-4a45-bb06-a5c58014a7de tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:10.700714 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3e55e9a9-4e78-4a45-bb06-a5c58014a7de tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:10.707113 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e55e9a9-4e78-4a45-bb06-a5c58014a7de tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:10.707594 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e55e9a9-4e78-4a45-bb06-a5c58014a7de tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:10.708023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e55e9a9-4e78-4a45-bb06-a5c58014a7de tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:10.708710 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e55e9a9-4e78-4a45-bb06-a5c58014a7de tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:10.709156 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e55e9a9-4e78-4a45-bb06-a5c58014a7de tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:10.709587 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3e55e9a9-4e78-4a45-bb06-a5c58014a7de tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:10.714877 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e37521ca-7391-494d-bc88-0498cbb6d668 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:10.724417 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e37521ca-7391-494d-bc88-0498cbb6d668 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:10.726584 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e37521ca-7391-494d-bc88-0498cbb6d668 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:10.727075 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e37521ca-7391-494d-bc88-0498cbb6d668 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1724 microversion: 2.20 time: 0.278700 Sep 04 16:20:10.736443 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 418/842] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:10 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1724 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:20:10.855938 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-3e55e9a9-4e78-4a45-bb06-a5c58014a7de tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:10.863738 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3e55e9a9-4e78-4a45-bb06-a5c58014a7de tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1569 microversion: 2.1 time: 0.167888 Sep 04 16:20:10.864302 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 425/843] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:10 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:10.911788 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f1e632f6-5762-4a46-8a8b-fa399620827e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:10.912402 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f1e632f6-5762-4a46-8a8b-fa399620827e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:10.918353 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1e632f6-5762-4a46-8a8b-fa399620827e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:10.918859 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1e632f6-5762-4a46-8a8b-fa399620827e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:10.919293 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1e632f6-5762-4a46-8a8b-fa399620827e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:10.919981 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1e632f6-5762-4a46-8a8b-fa399620827e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:10.920434 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1e632f6-5762-4a46-8a8b-fa399620827e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:10.920863 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f1e632f6-5762-4a46-8a8b-fa399620827e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:10.982060 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f1e632f6-5762-4a46-8a8b-fa399620827e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:10.989943 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f1e632f6-5762-4a46-8a8b-fa399620827e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1210 microversion: 2.1 time: 0.081953 Sep 04 16:20:10.990523 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 419/844] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:10 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:11.028084 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-63b2fe8a-6e33-4cbd-93bf-403ce2a5cff2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:11.030418 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-63b2fe8a-6e33-4cbd-93bf-403ce2a5cff2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:11.036513 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63b2fe8a-6e33-4cbd-93bf-403ce2a5cff2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:11.036998 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63b2fe8a-6e33-4cbd-93bf-403ce2a5cff2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:11.037438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63b2fe8a-6e33-4cbd-93bf-403ce2a5cff2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:11.038165 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63b2fe8a-6e33-4cbd-93bf-403ce2a5cff2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:11.038620 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63b2fe8a-6e33-4cbd-93bf-403ce2a5cff2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:11.039046 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-63b2fe8a-6e33-4cbd-93bf-403ce2a5cff2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:11.069895 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-63b2fe8a-6e33-4cbd-93bf-403ce2a5cff2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045779 Sep 04 16:20:11.070450 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 426/845] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:20:11 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:20:11.424759 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-11197b24-49e2-4254-96ee-9bf1c8d34541 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:11.425362 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-11197b24-49e2-4254-96ee-9bf1c8d34541 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:11.431324 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-11197b24-49e2-4254-96ee-9bf1c8d34541 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:11.431801 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-11197b24-49e2-4254-96ee-9bf1c8d34541 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:11.432231 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-11197b24-49e2-4254-96ee-9bf1c8d34541 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:11.432908 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-11197b24-49e2-4254-96ee-9bf1c8d34541 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:11.433352 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-11197b24-49e2-4254-96ee-9bf1c8d34541 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:11.433798 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-11197b24-49e2-4254-96ee-9bf1c8d34541 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:11.577161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-11197b24-49e2-4254-96ee-9bf1c8d34541 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:11.585491 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-11197b24-49e2-4254-96ee-9bf1c8d34541 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1757 microversion: 2.1 time: 0.164502 Sep 04 16:20:11.586066 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 420/846] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:11 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:11.640498 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-982c2867-16b2-4078-90af-0e2b813f2bc7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:11.641266 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-982c2867-16b2-4078-90af-0e2b813f2bc7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:11.647338 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:20:11.651600 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-982c2867-16b2-4078-90af-0e2b813f2bc7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:11.652446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-982c2867-16b2-4078-90af-0e2b813f2bc7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:11.653220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-982c2867-16b2-4078-90af-0e2b813f2bc7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:11.654186 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-982c2867-16b2-4078-90af-0e2b813f2bc7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:11.654858 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-982c2867-16b2-4078-90af-0e2b813f2bc7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:11.655433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-982c2867-16b2-4078-90af-0e2b813f2bc7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:11.753157 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f4e1e34e-d1cc-4725-a5a7-1fce56748635 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:11.754653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f4e1e34e-d1cc-4725-a5a7-1fce56748635 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:11.761019 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f4e1e34e-d1cc-4725-a5a7-1fce56748635 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:11.761781 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f4e1e34e-d1cc-4725-a5a7-1fce56748635 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:11.762225 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f4e1e34e-d1cc-4725-a5a7-1fce56748635 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:11.763768 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f4e1e34e-d1cc-4725-a5a7-1fce56748635 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:11.764520 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f4e1e34e-d1cc-4725-a5a7-1fce56748635 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:11.765374 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f4e1e34e-d1cc-4725-a5a7-1fce56748635 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:12.012325 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-982c2867-16b2-4078-90af-0e2b813f2bc7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:12.025189 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-982c2867-16b2-4078-90af-0e2b813f2bc7 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1506 microversion: 2.1 time: 0.388925 Sep 04 16:20:12.025823 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 427/847] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:11 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1506 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:12.047203 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-99c6bf9e-d9b3-4aa0-84d4-60d86bc070a9 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:12.048048 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-99c6bf9e-d9b3-4aa0-84d4-60d86bc070a9 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:12.054779 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99c6bf9e-d9b3-4aa0-84d4-60d86bc070a9 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:12.055345 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99c6bf9e-d9b3-4aa0-84d4-60d86bc070a9 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:12.055752 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99c6bf9e-d9b3-4aa0-84d4-60d86bc070a9 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:12.056631 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99c6bf9e-d9b3-4aa0-84d4-60d86bc070a9 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:12.057091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99c6bf9e-d9b3-4aa0-84d4-60d86bc070a9 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:12.057522 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-99c6bf9e-d9b3-4aa0-84d4-60d86bc070a9 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:12.189390 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f4e1e34e-d1cc-4725-a5a7-1fce56748635 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:12.198687 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f4e1e34e-d1cc-4725-a5a7-1fce56748635 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:12.199695 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f4e1e34e-d1cc-4725-a5a7-1fce56748635 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:12.200974 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f4e1e34e-d1cc-4725-a5a7-1fce56748635 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1724 microversion: 2.20 time: 0.451704 Sep 04 16:20:12.201757 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 421/848] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:11 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1724 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:20:12.223443 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2017a8db-954f-4305-a3e7-37872dca5cab tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:12.224354 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2017a8db-954f-4305-a3e7-37872dca5cab tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:12.230629 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2017a8db-954f-4305-a3e7-37872dca5cab tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:12.231063 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2017a8db-954f-4305-a3e7-37872dca5cab tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:12.232087 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2017a8db-954f-4305-a3e7-37872dca5cab tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:12.232792 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2017a8db-954f-4305-a3e7-37872dca5cab tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:12.233247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2017a8db-954f-4305-a3e7-37872dca5cab tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:12.233701 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2017a8db-954f-4305-a3e7-37872dca5cab tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:12.444391 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2017a8db-954f-4305-a3e7-37872dca5cab tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:12.453634 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2017a8db-954f-4305-a3e7-37872dca5cab tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1210 microversion: 2.1 time: 0.234876 Sep 04 16:20:12.454254 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 422/849] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:12 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1210 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:12.458997 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9e18cbdb-6107-49bd-84cf-cc1949f091b1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:12.461589 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9e18cbdb-6107-49bd-84cf-cc1949f091b1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:12.469861 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9e18cbdb-6107-49bd-84cf-cc1949f091b1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:12.477050 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9e18cbdb-6107-49bd-84cf-cc1949f091b1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:12.477050 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9e18cbdb-6107-49bd-84cf-cc1949f091b1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:12.477050 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9e18cbdb-6107-49bd-84cf-cc1949f091b1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:12.477050 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9e18cbdb-6107-49bd-84cf-cc1949f091b1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:12.477649 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9e18cbdb-6107-49bd-84cf-cc1949f091b1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:12.508261 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9e18cbdb-6107-49bd-84cf-cc1949f091b1 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052249 Sep 04 16:20:12.508261 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 423/850] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:20:12 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 04 16:20:12.587936 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fab6d5dc-26ae-4e8b-89e6-6d757d0c8ea6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:12.588439 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fab6d5dc-26ae-4e8b-89e6-6d757d0c8ea6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:12.594697 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-99c6bf9e-d9b3-4aa0-84d4-60d86bc070a9 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:12.597623 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fab6d5dc-26ae-4e8b-89e6-6d757d0c8ea6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:12.597623 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fab6d5dc-26ae-4e8b-89e6-6d757d0c8ea6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:12.597623 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fab6d5dc-26ae-4e8b-89e6-6d757d0c8ea6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:12.598382 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fab6d5dc-26ae-4e8b-89e6-6d757d0c8ea6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:12.598884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fab6d5dc-26ae-4e8b-89e6-6d757d0c8ea6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:12.599263 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fab6d5dc-26ae-4e8b-89e6-6d757d0c8ea6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:12.611824 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-99c6bf9e-d9b3-4aa0-84d4-60d86bc070a9 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1569 microversion: 2.1 time: 0.571402 Sep 04 16:20:12.619453 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 428/851] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:12 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1569 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:12.626022 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b94bb69d-64bc-4187-a2f3-edb9aec50309 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:12.626914 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b94bb69d-64bc-4187-a2f3-edb9aec50309 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:12.634312 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b94bb69d-64bc-4187-a2f3-edb9aec50309 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:12.634881 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b94bb69d-64bc-4187-a2f3-edb9aec50309 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:12.637948 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b94bb69d-64bc-4187-a2f3-edb9aec50309 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:12.638276 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fab6d5dc-26ae-4e8b-89e6-6d757d0c8ea6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 16:20:12.638468 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b94bb69d-64bc-4187-a2f3-edb9aec50309 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:12.638468 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b94bb69d-64bc-4187-a2f3-edb9aec50309 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:12.638998 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b94bb69d-64bc-4187-a2f3-edb9aec50309 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:12.866527 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:20:12.927870 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fab6d5dc-26ae-4e8b-89e6-6d757d0c8ea6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 204 len: 0 microversion: 2.1 time: 0.344170 Sep 04 16:20:12.928377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 424/852] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:20:12 2022] DELETE /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 04 16:20:12.939668 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ccf2ef91-cf3b-4734-980c-d63983512798 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:12.940425 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ccf2ef91-cf3b-4734-980c-d63983512798 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:12.947385 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ccf2ef91-cf3b-4734-980c-d63983512798 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:12.947882 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ccf2ef91-cf3b-4734-980c-d63983512798 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:12.956258 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ccf2ef91-cf3b-4734-980c-d63983512798 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:12.956258 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ccf2ef91-cf3b-4734-980c-d63983512798 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:12.956258 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ccf2ef91-cf3b-4734-980c-d63983512798 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:12.956258 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ccf2ef91-cf3b-4734-980c-d63983512798 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:13.395093 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ccf2ef91-cf3b-4734-980c-d63983512798 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:13.395296 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ccf2ef91-cf3b-4734-980c-d63983512798 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1681 microversion: 2.1 time: 0.460649 Sep 04 16:20:13.395867 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 425/853] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:12 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1681 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:13.409749 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-dcb1cf18-ad1d-4c04-8ca0-fab50eb1da2e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:13.409749 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-dcb1cf18-ad1d-4c04-8ca0-fab50eb1da2e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:13.409749 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dcb1cf18-ad1d-4c04-8ca0-fab50eb1da2e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:13.409749 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dcb1cf18-ad1d-4c04-8ca0-fab50eb1da2e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:13.410166 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dcb1cf18-ad1d-4c04-8ca0-fab50eb1da2e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:13.410166 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dcb1cf18-ad1d-4c04-8ca0-fab50eb1da2e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:13.410166 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dcb1cf18-ad1d-4c04-8ca0-fab50eb1da2e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:13.410166 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dcb1cf18-ad1d-4c04-8ca0-fab50eb1da2e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:13.412661 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b94bb69d-64bc-4187-a2f3-edb9aec50309 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:13.423685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b94bb69d-64bc-4187-a2f3-edb9aec50309 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1757 microversion: 2.1 time: 0.801497 Sep 04 16:20:13.424275 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 429/854] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:12 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1757 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:13.430117 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fe0a2a60-1c62-4b5a-8cd2-c192e22031bc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:13.430722 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fe0a2a60-1c62-4b5a-8cd2-c192e22031bc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:13.439388 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe0a2a60-1c62-4b5a-8cd2-c192e22031bc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:13.439956 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe0a2a60-1c62-4b5a-8cd2-c192e22031bc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:13.440547 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe0a2a60-1c62-4b5a-8cd2-c192e22031bc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:13.441202 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe0a2a60-1c62-4b5a-8cd2-c192e22031bc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:13.441682 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe0a2a60-1c62-4b5a-8cd2-c192e22031bc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:13.442100 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fe0a2a60-1c62-4b5a-8cd2-c192e22031bc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:13.520143 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-dcb1cf18-ad1d-4c04-8ca0-fab50eb1da2e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:13.529367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-dcb1cf18-ad1d-4c04-8ca0-fab50eb1da2e tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1464 microversion: 2.1 time: 0.132137 Sep 04 16:20:13.529978 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 426/855] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:13 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1464 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:13.534889 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6e5f849d-27e4-46be-8446-15d8f9e6eef7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:13.535856 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6e5f849d-27e4-46be-8446-15d8f9e6eef7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:13.542380 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6e5f849d-27e4-46be-8446-15d8f9e6eef7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:13.543121 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6e5f849d-27e4-46be-8446-15d8f9e6eef7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:13.544338 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6e5f849d-27e4-46be-8446-15d8f9e6eef7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:13.545329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6e5f849d-27e4-46be-8446-15d8f9e6eef7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:13.545996 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6e5f849d-27e4-46be-8446-15d8f9e6eef7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:13.546571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6e5f849d-27e4-46be-8446-15d8f9e6eef7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:13.877802 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-fe0a2a60-1c62-4b5a-8cd2-c192e22031bc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:13.889822 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-fe0a2a60-1c62-4b5a-8cd2-c192e22031bc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:13.891598 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-fe0a2a60-1c62-4b5a-8cd2-c192e22031bc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:13.892976 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fe0a2a60-1c62-4b5a-8cd2-c192e22031bc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1724 microversion: 2.20 time: 0.467390 Sep 04 16:20:13.893986 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 430/856] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:13 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1724 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:13.899400 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e42c9009-63be-42cf-8d26-06c8dcc8a27a tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:13.900108 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e42c9009-63be-42cf-8d26-06c8dcc8a27a tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:13.900505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-6e5f849d-27e4-46be-8446-15d8f9e6eef7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:13.907253 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e42c9009-63be-42cf-8d26-06c8dcc8a27a tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:13.908067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e42c9009-63be-42cf-8d26-06c8dcc8a27a tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:13.908835 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e42c9009-63be-42cf-8d26-06c8dcc8a27a tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:13.909802 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e42c9009-63be-42cf-8d26-06c8dcc8a27a tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:13.910463 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e42c9009-63be-42cf-8d26-06c8dcc8a27a tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:13.911045 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e42c9009-63be-42cf-8d26-06c8dcc8a27a tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:13.911519 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6e5f849d-27e4-46be-8446-15d8f9e6eef7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1278 microversion: 2.1 time: 0.380079 Sep 04 16:20:13.912211 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 427/857] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:13 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1278 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:13.921813 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-86835bd4-d03e-4ee7-b9de-188ef41a2d9e req-971e028b-0ccd-458e-a98c-77619e8a788c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df07895-c9cb-4cee-93e7-1cafff31b091", "name": "network-vif-deleted", "tag": "dab8e735-7496-45d4-bc92-b047426a274b"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:20:13.931259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-86835bd4-d03e-4ee7-b9de-188ef41a2d9e req-971e028b-0ccd-458e-a98c-77619e8a788c service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:13.931259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-86835bd4-d03e-4ee7-b9de-188ef41a2d9e req-971e028b-0ccd-458e-a98c-77619e8a788c service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:13.931259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-86835bd4-d03e-4ee7-b9de-188ef41a2d9e req-971e028b-0ccd-458e-a98c-77619e8a788c service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:13.943251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-86835bd4-d03e-4ee7-b9de-188ef41a2d9e req-971e028b-0ccd-458e-a98c-77619e8a788c service nova] Creating event network-vif-deleted:dab8e735-7496-45d4-bc92-b047426a274b for instance 9df07895-c9cb-4cee-93e7-1cafff31b091 on hv-cinder-85236 Sep 04 16:20:13.948311 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-86835bd4-d03e-4ee7-b9de-188ef41a2d9e req-971e028b-0ccd-458e-a98c-77619e8a788c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034444 Sep 04 16:20:13.948922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 428/858] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:20:14.069526 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e42c9009-63be-42cf-8d26-06c8dcc8a27a tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:14.077799 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e42c9009-63be-42cf-8d26-06c8dcc8a27a tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1569 microversion: 2.1 time: 0.182534 Sep 04 16:20:14.078375 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 431/859] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:13 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:14.425291 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cae61f14-0ec0-4482-b3cc-5bc094e2fa61 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:14.426034 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cae61f14-0ec0-4482-b3cc-5bc094e2fa61 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:14.432258 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cae61f14-0ec0-4482-b3cc-5bc094e2fa61 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:14.432740 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cae61f14-0ec0-4482-b3cc-5bc094e2fa61 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:14.433177 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cae61f14-0ec0-4482-b3cc-5bc094e2fa61 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:14.433894 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cae61f14-0ec0-4482-b3cc-5bc094e2fa61 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:14.434937 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cae61f14-0ec0-4482-b3cc-5bc094e2fa61 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:14.435420 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cae61f14-0ec0-4482-b3cc-5bc094e2fa61 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:14.447779 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-716bae9a-198c-4e92-8ab2-ae91a01c4ddd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:14.448404 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-716bae9a-198c-4e92-8ab2-ae91a01c4ddd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:14.455359 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-716bae9a-198c-4e92-8ab2-ae91a01c4ddd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:14.455837 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-716bae9a-198c-4e92-8ab2-ae91a01c4ddd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:14.456261 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-716bae9a-198c-4e92-8ab2-ae91a01c4ddd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:14.456949 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-716bae9a-198c-4e92-8ab2-ae91a01c4ddd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:14.457392 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-716bae9a-198c-4e92-8ab2-ae91a01c4ddd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:14.457844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-716bae9a-198c-4e92-8ab2-ae91a01c4ddd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:14.631631 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-cae61f14-0ec0-4482-b3cc-5bc094e2fa61 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:14.641091 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cae61f14-0ec0-4482-b3cc-5bc094e2fa61 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1681 microversion: 2.1 time: 0.220001 Sep 04 16:20:14.641901 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 429/860] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:14 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1681 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:14.646721 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d138832f-8215-4009-8dd6-9fe446ae4149 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:14.647320 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d138832f-8215-4009-8dd6-9fe446ae4149 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:14.653383 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d138832f-8215-4009-8dd6-9fe446ae4149 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:14.654529 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d138832f-8215-4009-8dd6-9fe446ae4149 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:14.654970 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d138832f-8215-4009-8dd6-9fe446ae4149 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:14.655669 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d138832f-8215-4009-8dd6-9fe446ae4149 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:14.656130 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d138832f-8215-4009-8dd6-9fe446ae4149 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:14.656555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d138832f-8215-4009-8dd6-9fe446ae4149 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:14.673580 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-716bae9a-198c-4e92-8ab2-ae91a01c4ddd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:14.681900 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-716bae9a-198c-4e92-8ab2-ae91a01c4ddd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1757 microversion: 2.1 time: 0.237936 Sep 04 16:20:14.682551 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 432/861] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:14 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1757 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:14.722576 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d138832f-8215-4009-8dd6-9fe446ae4149 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:14.730233 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d138832f-8215-4009-8dd6-9fe446ae4149 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1464 microversion: 2.1 time: 0.087525 Sep 04 16:20:14.730801 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 430/862] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:14 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1464 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:14.925881 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b4fe86d0-21d2-4672-be47-ac6b4149c881 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:14.926413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b4fe86d0-21d2-4672-be47-ac6b4149c881 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:14.932318 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4fe86d0-21d2-4672-be47-ac6b4149c881 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:14.932794 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4fe86d0-21d2-4672-be47-ac6b4149c881 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:14.933222 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4fe86d0-21d2-4672-be47-ac6b4149c881 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:14.933925 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4fe86d0-21d2-4672-be47-ac6b4149c881 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:14.934959 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4fe86d0-21d2-4672-be47-ac6b4149c881 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:14.935380 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b4fe86d0-21d2-4672-be47-ac6b4149c881 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:14.939984 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9baf40fc-4e7c-4356-a59d-8b3274f628a1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:14.940736 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9baf40fc-4e7c-4356-a59d-8b3274f628a1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:14.947015 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9baf40fc-4e7c-4356-a59d-8b3274f628a1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:14.947498 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9baf40fc-4e7c-4356-a59d-8b3274f628a1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:14.947933 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9baf40fc-4e7c-4356-a59d-8b3274f628a1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:14.948628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9baf40fc-4e7c-4356-a59d-8b3274f628a1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:14.949080 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9baf40fc-4e7c-4356-a59d-8b3274f628a1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:14.949499 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9baf40fc-4e7c-4356-a59d-8b3274f628a1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:15.118968 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b4fe86d0-21d2-4672-be47-ac6b4149c881 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:15.127179 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b4fe86d0-21d2-4672-be47-ac6b4149c881 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:15.128604 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b4fe86d0-21d2-4672-be47-ac6b4149c881 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:15.129779 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b4fe86d0-21d2-4672-be47-ac6b4149c881 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1724 microversion: 2.20 time: 0.207856 Sep 04 16:20:15.130337 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 433/863] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:14 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:15.134665 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-afa7dc66-ee90-420d-8c55-e3b3a9978aef tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:15.135261 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-afa7dc66-ee90-420d-8c55-e3b3a9978aef tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:15.141524 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afa7dc66-ee90-420d-8c55-e3b3a9978aef tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:15.142031 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afa7dc66-ee90-420d-8c55-e3b3a9978aef tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:15.142458 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afa7dc66-ee90-420d-8c55-e3b3a9978aef tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:15.143141 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afa7dc66-ee90-420d-8c55-e3b3a9978aef tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:15.143585 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afa7dc66-ee90-420d-8c55-e3b3a9978aef tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:15.144001 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afa7dc66-ee90-420d-8c55-e3b3a9978aef tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:15.147214 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9baf40fc-4e7c-4356-a59d-8b3274f628a1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:15.150765 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:20:15.156090 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9baf40fc-4e7c-4356-a59d-8b3274f628a1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1278 microversion: 2.1 time: 0.220052 Sep 04 16:20:15.156669 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 431/864] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:14 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1278 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:15.286765 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-afa7dc66-ee90-420d-8c55-e3b3a9978aef tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:15.294855 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-afa7dc66-ee90-420d-8c55-e3b3a9978aef tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1569 microversion: 2.1 time: 0.163549 Sep 04 16:20:15.295432 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 434/865] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:15 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:15.666624 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-413116de-51c5-49f5-bc8c-0303584d848d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:15.667133 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-413116de-51c5-49f5-bc8c-0303584d848d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:15.674982 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-413116de-51c5-49f5-bc8c-0303584d848d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:15.675471 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-413116de-51c5-49f5-bc8c-0303584d848d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:15.675905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-413116de-51c5-49f5-bc8c-0303584d848d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:15.676635 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-413116de-51c5-49f5-bc8c-0303584d848d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:15.677088 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-413116de-51c5-49f5-bc8c-0303584d848d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:15.677510 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-413116de-51c5-49f5-bc8c-0303584d848d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:15.706895 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e3792a03-1d0e-4bfc-a1dd-177b0a0f0358 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:15.707504 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e3792a03-1d0e-4bfc-a1dd-177b0a0f0358 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:15.722012 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3792a03-1d0e-4bfc-a1dd-177b0a0f0358 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:15.722531 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3792a03-1d0e-4bfc-a1dd-177b0a0f0358 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:15.722971 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3792a03-1d0e-4bfc-a1dd-177b0a0f0358 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:15.723877 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3792a03-1d0e-4bfc-a1dd-177b0a0f0358 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:15.724496 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3792a03-1d0e-4bfc-a1dd-177b0a0f0358 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:15.724918 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e3792a03-1d0e-4bfc-a1dd-177b0a0f0358 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:16.192608 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-413116de-51c5-49f5-bc8c-0303584d848d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:16.203168 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-413116de-51c5-49f5-bc8c-0303584d848d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1681 microversion: 2.1 time: 0.541246 Sep 04 16:20:16.204456 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 432/866] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:15 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1681 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:16.209702 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-47afbca5-48c1-48af-a09a-d405e936ecfa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:16.210616 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-47afbca5-48c1-48af-a09a-d405e936ecfa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:16.227716 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-47afbca5-48c1-48af-a09a-d405e936ecfa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:16.231690 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-47afbca5-48c1-48af-a09a-d405e936ecfa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:16.231690 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-47afbca5-48c1-48af-a09a-d405e936ecfa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:16.231690 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-47afbca5-48c1-48af-a09a-d405e936ecfa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:16.233841 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-47afbca5-48c1-48af-a09a-d405e936ecfa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:16.236635 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-47afbca5-48c1-48af-a09a-d405e936ecfa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:16.240016 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e3792a03-1d0e-4bfc-a1dd-177b0a0f0358 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:16.253422 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e3792a03-1d0e-4bfc-a1dd-177b0a0f0358 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1757 microversion: 2.1 time: 0.549608 Sep 04 16:20:16.254597 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 435/867] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:15 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1757 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:16.263083 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c471a8fa-9bcf-4660-8558-84a1011dc87d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:16.263927 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c471a8fa-9bcf-4660-8558-84a1011dc87d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:16.270493 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c471a8fa-9bcf-4660-8558-84a1011dc87d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:16.271624 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c471a8fa-9bcf-4660-8558-84a1011dc87d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:16.272427 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c471a8fa-9bcf-4660-8558-84a1011dc87d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:16.273352 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c471a8fa-9bcf-4660-8558-84a1011dc87d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:16.274061 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c471a8fa-9bcf-4660-8558-84a1011dc87d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:16.274729 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c471a8fa-9bcf-4660-8558-84a1011dc87d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:16.279994 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:20:16.325148 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-47afbca5-48c1-48af-a09a-d405e936ecfa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:16.326615 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-47afbca5-48c1-48af-a09a-d405e936ecfa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:16.327167 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-47afbca5-48c1-48af-a09a-d405e936ecfa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:16.327638 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-47afbca5-48c1-48af-a09a-d405e936ecfa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lazy-loading 'fault' on Instance uuid 9df07895-c9cb-4cee-93e7-1cafff31b091 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:20:16.454827 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-47afbca5-48c1-48af-a09a-d405e936ecfa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:16.464184 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-47afbca5-48c1-48af-a09a-d405e936ecfa tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 200 len: 1311 microversion: 2.1 time: 0.258090 Sep 04 16:20:16.471847 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 433/868] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:16 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 1311 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:16.471847 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0e6f9169-b536-405a-8342-b33b0fc5cc50 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:16.472204 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0e6f9169-b536-405a-8342-b33b0fc5cc50 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:16.479235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0e6f9169-b536-405a-8342-b33b0fc5cc50 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:16.480391 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0e6f9169-b536-405a-8342-b33b0fc5cc50 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:16.480391 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0e6f9169-b536-405a-8342-b33b0fc5cc50 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:16.481093 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0e6f9169-b536-405a-8342-b33b0fc5cc50 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:16.482284 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0e6f9169-b536-405a-8342-b33b0fc5cc50 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:16.484232 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0e6f9169-b536-405a-8342-b33b0fc5cc50 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:16.708959 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c471a8fa-9bcf-4660-8558-84a1011dc87d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:16.720229 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c471a8fa-9bcf-4660-8558-84a1011dc87d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:16.721111 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c471a8fa-9bcf-4660-8558-84a1011dc87d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:16.722326 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c471a8fa-9bcf-4660-8558-84a1011dc87d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1724 microversion: 2.20 time: 0.466125 Sep 04 16:20:16.723095 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 436/869] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:16 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1724 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:16.729066 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cd5115ba-9dfd-4694-9cf0-d2b5a5311963 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:16.729706 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cd5115ba-9dfd-4694-9cf0-d2b5a5311963 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:16.737179 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd5115ba-9dfd-4694-9cf0-d2b5a5311963 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:16.737830 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd5115ba-9dfd-4694-9cf0-d2b5a5311963 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:16.738326 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd5115ba-9dfd-4694-9cf0-d2b5a5311963 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:16.739159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd5115ba-9dfd-4694-9cf0-d2b5a5311963 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:16.739696 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd5115ba-9dfd-4694-9cf0-d2b5a5311963 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:16.740291 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cd5115ba-9dfd-4694-9cf0-d2b5a5311963 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:16.916755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-0e6f9169-b536-405a-8342-b33b0fc5cc50 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:16.926015 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0e6f9169-b536-405a-8342-b33b0fc5cc50 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1266 microversion: 2.1 time: 0.458615 Sep 04 16:20:16.926804 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 434/870] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:16 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1266 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:17.009754 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-5db46356-7fd7-4701-a9a3-5f19f9b49331 req-174a1fee-56e5-4c8f-9366-78f7cb94d9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84acd9f2-8732-4d8b-843e-46e2ccd5e5cc", "name": "network-vif-unplugged", "status": "completed", "tag": "b7aa303d-deea-4135-89b8-303faf88bdfe"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:20:17.016785 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:20:17.020616 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-5db46356-7fd7-4701-a9a3-5f19f9b49331 req-174a1fee-56e5-4c8f-9366-78f7cb94d9c8 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:17.021096 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-5db46356-7fd7-4701-a9a3-5f19f9b49331 req-174a1fee-56e5-4c8f-9366-78f7cb94d9c8 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:17.021833 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-5db46356-7fd7-4701-a9a3-5f19f9b49331 req-174a1fee-56e5-4c8f-9366-78f7cb94d9c8 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:17.034309 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-5db46356-7fd7-4701-a9a3-5f19f9b49331 req-174a1fee-56e5-4c8f-9366-78f7cb94d9c8 service nova] Creating event network-vif-unplugged:b7aa303d-deea-4135-89b8-303faf88bdfe for instance 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc on hv-cinder-85236 Sep 04 16:20:17.039468 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-5db46356-7fd7-4701-a9a3-5f19f9b49331 req-174a1fee-56e5-4c8f-9366-78f7cb94d9c8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111215 Sep 04 16:20:17.040063 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:20:17.040483 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 435/871] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:20:17.080221 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-cd5115ba-9dfd-4694-9cf0-d2b5a5311963 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:17.088195 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cd5115ba-9dfd-4694-9cf0-d2b5a5311963 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1569 microversion: 2.1 time: 0.363671 Sep 04 16:20:17.088777 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 437/872] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:16 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1569 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:17.232902 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-92f46bfc-fde2-40c9-ae0c-3709af7ece6d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:17.234770 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-92f46bfc-fde2-40c9-ae0c-3709af7ece6d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:17.242955 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-92f46bfc-fde2-40c9-ae0c-3709af7ece6d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:17.243916 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-92f46bfc-fde2-40c9-ae0c-3709af7ece6d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:17.243916 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-92f46bfc-fde2-40c9-ae0c-3709af7ece6d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:17.244531 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-92f46bfc-fde2-40c9-ae0c-3709af7ece6d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:17.245013 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-92f46bfc-fde2-40c9-ae0c-3709af7ece6d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:17.245459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-92f46bfc-fde2-40c9-ae0c-3709af7ece6d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:17.254432 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-28b1ab72-f6d6-4de2-a92b-4c645de48fbe req-c80d89c4-3012-430f-be8b-f19a42012c96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c65f38-de9c-4de3-8cf5-92147eb37728", "tag": "329a6f01-f405-46c1-8565-cde5c89b347e"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:20:17.290133 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-28b1ab72-f6d6-4de2-a92b-4c645de48fbe req-c80d89c4-3012-430f-be8b-f19a42012c96 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:17.290897 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-28b1ab72-f6d6-4de2-a92b-4c645de48fbe req-c80d89c4-3012-430f-be8b-f19a42012c96 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:17.291484 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-28b1ab72-f6d6-4de2-a92b-4c645de48fbe req-c80d89c4-3012-430f-be8b-f19a42012c96 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:17.306211 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-28b1ab72-f6d6-4de2-a92b-4c645de48fbe req-c80d89c4-3012-430f-be8b-f19a42012c96 service nova] Creating event network-changed:329a6f01-f405-46c1-8565-cde5c89b347e for instance 04c65f38-de9c-4de3-8cf5-92147eb37728 on hv-cinder-85236 Sep 04 16:20:17.312213 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-28b1ab72-f6d6-4de2-a92b-4c645de48fbe req-c80d89c4-3012-430f-be8b-f19a42012c96 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062229 Sep 04 16:20:17.313134 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 438/873] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:20:17.318411 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5cb44e93-715c-4ab5-8dea-169d992a5dca tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:17.319179 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5cb44e93-715c-4ab5-8dea-169d992a5dca tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:17.326693 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5cb44e93-715c-4ab5-8dea-169d992a5dca tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:17.327187 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5cb44e93-715c-4ab5-8dea-169d992a5dca tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:17.327620 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5cb44e93-715c-4ab5-8dea-169d992a5dca tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:17.328323 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5cb44e93-715c-4ab5-8dea-169d992a5dca tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:17.328776 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5cb44e93-715c-4ab5-8dea-169d992a5dca tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:17.329753 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5cb44e93-715c-4ab5-8dea-169d992a5dca tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:17.412456 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-92f46bfc-fde2-40c9-ae0c-3709af7ece6d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:17.422920 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-92f46bfc-fde2-40c9-ae0c-3709af7ece6d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1614 microversion: 2.1 time: 0.194340 Sep 04 16:20:17.423968 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 436/874] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:17 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1614 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:17.488761 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3f480c7a-9857-4c4e-a6af-f0fbac39b438 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:17.489349 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3f480c7a-9857-4c4e-a6af-f0fbac39b438 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: 9df07895-c9cb-4cee-93e7-1cafff31b091] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:17.495799 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3f480c7a-9857-4c4e-a6af-f0fbac39b438 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:17.496284 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3f480c7a-9857-4c4e-a6af-f0fbac39b438 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:17.496722 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3f480c7a-9857-4c4e-a6af-f0fbac39b438 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:17.498068 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3f480c7a-9857-4c4e-a6af-f0fbac39b438 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:17.498460 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3f480c7a-9857-4c4e-a6af-f0fbac39b438 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:17.498883 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3f480c7a-9857-4c4e-a6af-f0fbac39b438 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:17.513702 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-3f480c7a-9857-4c4e-a6af-f0fbac39b438 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] HTTP exception thrown: Instance 9df07895-c9cb-4cee-93e7-1cafff31b091 could not be found. Sep 04 16:20:17.515329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3f480c7a-9857-4c4e-a6af-f0fbac39b438 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Request method failure captured: Sep 04 16:20:17.515329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 HTTP/1.1 Sep 04 16:20:17.515329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:20:17.515329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:20:17.515329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:20:17.515329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:20:17.515329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:20:17.515329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:20:17.515329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:20:17.515329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:20:17.515329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFM7AQu8qea0BFPhZJJD1SjpMjCb9OT3yqcZNamIbdv_2tiOBslm23HUMyFLRuEja9zOxHSb7HCyTIWbzZ5oqcjUZcQ0rElKr7qovko9hAD8HBN652TVbu8E6ygcWWlMFsAALAQQiHxyfrlUQj8PuQ9eIFVlDfwklsO4cKSYRuTyg9y4 Sep 04 16:20:17.515329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:20:17.515329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:20:17.515329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:20:17.515329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:20:17.515329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:20:17.515329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:20:17.515329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: cb043a0ecad3466bbd5a5874126d2810 Sep 04 16:20:17.515329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1718450479 Sep 04 16:20:17.515329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:20:17.515329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:20:17.516914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cb043a0ecad3466bbd5a5874126d2810"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb043a0ecad3466bbd5a5874126d2810"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cb043a0ecad3466bbd5a5874126d2810", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb043a0ecad3466bbd5a5874126d2810"}]}] Sep 04 16:20:17.516914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1718450479 Sep 04 16:20:17.516914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: cb043a0ecad3466bbd5a5874126d2810 Sep 04 16:20:17.516914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1718450479 Sep 04 16:20:17.516914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-ServerRescueNegativeTestJSON-1718450479-project Sep 04 16:20:17.516914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:20:17.516914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:20:17.516914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: a9d55c52717546b09d93d956a29f49a9 Sep 04 16:20:17.516914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1718450479-project Sep 04 16:20:17.516914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: > Sep 04 16:20:17.516914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Instance 9df07895-c9cb-4cee-93e7-1cafff31b091 could not be found. Sep 04 16:20:17.516914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': '9df07895-c9cb-4cee-93e7-1cafff31b091'} Sep 04 16:20:17.517755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:20:17.517755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:20:17.517755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:20:17.517755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:20:17.517755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:20:17.517755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:20:17.517755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:20:17.517755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:20:17.517755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:20:17.517755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:20:17.517755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9df07895-c9cb-4cee-93e7-1cafff31b091 could not be found. Sep 04 16:20:17.517755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:20:17.517755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:20:17.517755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:20:17.517755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:20:17.517755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:20:17.517755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:20:17.517755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:20:17.517755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:20:17.517755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:20:17.518966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:20:17.518966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:20:17.518966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:20:17.518966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:20:17.518966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:20:17.518966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:20:17.518966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:20:17.518966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9df07895-c9cb-4cee-93e7-1cafff31b091 could not be found. Sep 04 16:20:17.518966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:20:17.518966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:20:17.518966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:20:17.518966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:20:17.518966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:20:17.518966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:20:17.518966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:20:17.518966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:20:17.518966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9df07895-c9cb-4cee-93e7-1cafff31b091 could not be found. Sep 04 16:20:17.518966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:20:17.520053 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3f480c7a-9857-4c4e-a6af-f0fbac39b438 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Returning 404 to user: Instance 9df07895-c9cb-4cee-93e7-1cafff31b091 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:20:17.520053 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3f480c7a-9857-4c4e-a6af-f0fbac39b438 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091" status: 404 len: 111 microversion: 2.1 time: 0.032183 Sep 04 16:20:17.520053 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 437/875] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:17 2022] GET /compute/v2.1/servers/9df07895-c9cb-4cee-93e7-1cafff31b091 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 04 16:20:17.525686 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-13f2afb1-1f45-49bb-a025-5725dce865b5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:17.536579 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-13f2afb1-1f45-49bb-a025-5725dce865b5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:17.536579 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-13f2afb1-1f45-49bb-a025-5725dce865b5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:17.536579 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-13f2afb1-1f45-49bb-a025-5725dce865b5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:17.536579 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-13f2afb1-1f45-49bb-a025-5725dce865b5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:17.536971 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-13f2afb1-1f45-49bb-a025-5725dce865b5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:17.536971 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-13f2afb1-1f45-49bb-a025-5725dce865b5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:17.536971 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-13f2afb1-1f45-49bb-a025-5725dce865b5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:17.564464 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-13f2afb1-1f45-49bb-a025-5725dce865b5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 16:20:17.667197 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:20:17.686682 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5cb44e93-715c-4ab5-8dea-169d992a5dca tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:17.695595 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5cb44e93-715c-4ab5-8dea-169d992a5dca tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1757 microversion: 2.1 time: 0.381005 Sep 04 16:20:17.696166 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 439/876] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:17 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1757 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:17.753291 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f80df030-447e-4c1f-9b6a-a4310be1de82 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:17.754918 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f80df030-447e-4c1f-9b6a-a4310be1de82 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:17.762165 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f80df030-447e-4c1f-9b6a-a4310be1de82 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:17.764613 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f80df030-447e-4c1f-9b6a-a4310be1de82 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:17.770457 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f80df030-447e-4c1f-9b6a-a4310be1de82 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:17.776875 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f80df030-447e-4c1f-9b6a-a4310be1de82 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:17.778053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f80df030-447e-4c1f-9b6a-a4310be1de82 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:17.788989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f80df030-447e-4c1f-9b6a-a4310be1de82 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:17.906238 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-13f2afb1-1f45-49bb-a025-5725dce865b5 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 204 len: 0 microversion: 2.1 time: 0.384221 Sep 04 16:20:17.907514 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 438/877] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:20:17 2022] DELETE /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 04 16:20:17.916444 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-94fbd8e7-bbe9-42b0-a70b-a041c0e033df tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:17.917417 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-94fbd8e7-bbe9-42b0-a70b-a041c0e033df tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:17.924645 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-94fbd8e7-bbe9-42b0-a70b-a041c0e033df tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:17.925269 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-94fbd8e7-bbe9-42b0-a70b-a041c0e033df tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:17.925830 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-94fbd8e7-bbe9-42b0-a70b-a041c0e033df tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:17.926616 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-94fbd8e7-bbe9-42b0-a70b-a041c0e033df tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:17.927138 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-94fbd8e7-bbe9-42b0-a70b-a041c0e033df tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:17.927627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-94fbd8e7-bbe9-42b0-a70b-a041c0e033df tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:18.384984 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f80df030-447e-4c1f-9b6a-a4310be1de82 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:18.394407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f80df030-447e-4c1f-9b6a-a4310be1de82 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:18.395762 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f80df030-447e-4c1f-9b6a-a4310be1de82 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:18.397688 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f80df030-447e-4c1f-9b6a-a4310be1de82 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1724 microversion: 2.20 time: 0.648394 Sep 04 16:20:18.398513 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 440/878] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:17 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1724 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:20:18.402670 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-94fbd8e7-bbe9-42b0-a70b-a041c0e033df tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:18.415514 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-94fbd8e7-bbe9-42b0-a70b-a041c0e033df tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1521 microversion: 2.1 time: 0.503657 Sep 04 16:20:18.416362 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 439/879] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:17 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1521 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:18.420212 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-101a8190-8da4-4d2e-a7b0-258d1cd09745 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:18.420868 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-101a8190-8da4-4d2e-a7b0-258d1cd09745 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:18.425712 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a65f23e5-4ffc-4a43-a8fb-86c19b5a8945 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:18.426270 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a65f23e5-4ffc-4a43-a8fb-86c19b5a8945 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:18.432235 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-101a8190-8da4-4d2e-a7b0-258d1cd09745 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:18.432793 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-101a8190-8da4-4d2e-a7b0-258d1cd09745 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:18.437071 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-101a8190-8da4-4d2e-a7b0-258d1cd09745 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:18.437071 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-101a8190-8da4-4d2e-a7b0-258d1cd09745 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:18.437071 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-101a8190-8da4-4d2e-a7b0-258d1cd09745 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:18.437071 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-101a8190-8da4-4d2e-a7b0-258d1cd09745 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:18.442454 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a65f23e5-4ffc-4a43-a8fb-86c19b5a8945 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:18.442937 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a65f23e5-4ffc-4a43-a8fb-86c19b5a8945 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:18.443403 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a65f23e5-4ffc-4a43-a8fb-86c19b5a8945 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:18.444085 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a65f23e5-4ffc-4a43-a8fb-86c19b5a8945 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:18.444528 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a65f23e5-4ffc-4a43-a8fb-86c19b5a8945 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:18.444941 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a65f23e5-4ffc-4a43-a8fb-86c19b5a8945 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:18.640563 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-101a8190-8da4-4d2e-a7b0-258d1cd09745 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:18.649334 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-101a8190-8da4-4d2e-a7b0-258d1cd09745 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1266 microversion: 2.1 time: 0.249559 Sep 04 16:20:18.650033 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 441/880] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:18 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:18.656587 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-dd35f547-c138-4201-bcb5-d5c5b2bcf87c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:18.657316 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-dd35f547-c138-4201-bcb5-d5c5b2bcf87c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:18.664952 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd35f547-c138-4201-bcb5-d5c5b2bcf87c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:18.665606 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd35f547-c138-4201-bcb5-d5c5b2bcf87c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:18.666787 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd35f547-c138-4201-bcb5-d5c5b2bcf87c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:18.668028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd35f547-c138-4201-bcb5-d5c5b2bcf87c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:18.668442 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd35f547-c138-4201-bcb5-d5c5b2bcf87c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:18.669340 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a65f23e5-4ffc-4a43-a8fb-86c19b5a8945 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:18.670033 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-dd35f547-c138-4201-bcb5-d5c5b2bcf87c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:18.680258 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a65f23e5-4ffc-4a43-a8fb-86c19b5a8945 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1510 microversion: 2.1 time: 0.262516 Sep 04 16:20:18.680846 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 440/881] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:18 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1510 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:18.707127 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d606bd87-f49a-4aa4-8157-32796fcd7a55 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:20:18.708003 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d606bd87-f49a-4aa4-8157-32796fcd7a55 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:18.714775 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d606bd87-f49a-4aa4-8157-32796fcd7a55 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:18.715256 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d606bd87-f49a-4aa4-8157-32796fcd7a55 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:18.718308 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d606bd87-f49a-4aa4-8157-32796fcd7a55 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:18.719258 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d606bd87-f49a-4aa4-8157-32796fcd7a55 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:18.719778 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d606bd87-f49a-4aa4-8157-32796fcd7a55 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:18.720133 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d606bd87-f49a-4aa4-8157-32796fcd7a55 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:18.738641 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-dd35f547-c138-4201-bcb5-d5c5b2bcf87c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:18.748938 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-dd35f547-c138-4201-bcb5-d5c5b2bcf87c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1614 microversion: 2.1 time: 0.097785 Sep 04 16:20:18.758692 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 442/882] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:18 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1614 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:18.758692 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9a230dfd-e822-48de-af1b-76579b92514b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:18.758692 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9a230dfd-e822-48de-af1b-76579b92514b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:18.763193 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9a230dfd-e822-48de-af1b-76579b92514b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:18.763193 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9a230dfd-e822-48de-af1b-76579b92514b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:18.763193 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9a230dfd-e822-48de-af1b-76579b92514b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:18.763193 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9a230dfd-e822-48de-af1b-76579b92514b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:18.763535 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9a230dfd-e822-48de-af1b-76579b92514b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:18.763958 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9a230dfd-e822-48de-af1b-76579b92514b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:18.850523 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d606bd87-f49a-4aa4-8157-32796fcd7a55 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121041) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 04 16:20:18.927187 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-9a230dfd-e822-48de-af1b-76579b92514b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:18.936367 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9a230dfd-e822-48de-af1b-76579b92514b tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1757 microversion: 2.1 time: 0.185394 Sep 04 16:20:18.941603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 443/883] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:18 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:19.180819 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d606bd87-f49a-4aa4-8157-32796fcd7a55 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "POST /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc/action" status: 202 len: 0 microversion: 2.1 time: 0.477369 Sep 04 16:20:19.181357 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 441/884] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Sep 4 16:20:18 2022] POST /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 04 16:20:19.190217 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-194d5955-77ed-489c-a698-0141bc4d37dc tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:19.190827 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-194d5955-77ed-489c-a698-0141bc4d37dc tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:19.196798 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-194d5955-77ed-489c-a698-0141bc4d37dc tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:19.197273 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-194d5955-77ed-489c-a698-0141bc4d37dc tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:19.197775 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-194d5955-77ed-489c-a698-0141bc4d37dc tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:19.198464 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-194d5955-77ed-489c-a698-0141bc4d37dc tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:19.198918 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-194d5955-77ed-489c-a698-0141bc4d37dc tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:19.199373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-194d5955-77ed-489c-a698-0141bc4d37dc tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:19.338788 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-89e15ae4-6948-4b1a-a3b2-456f1b9f0177 req-020e5411-cfba-45e5-a8e8-23136ddffaf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e5636f2-5f2f-45ca-af8a-d998079502df", "name": "network-vif-deleted", "tag": "5109bc3e-5bc8-407d-b0e7-4d3d700d2044"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:20:19.340234 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-194d5955-77ed-489c-a698-0141bc4d37dc tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:19.348579 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-89e15ae4-6948-4b1a-a3b2-456f1b9f0177 req-020e5411-cfba-45e5-a8e8-23136ddffaf0 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:19.348745 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-194d5955-77ed-489c-a698-0141bc4d37dc tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1518 microversion: 2.1 time: 0.162210 Sep 04 16:20:19.349057 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-89e15ae4-6948-4b1a-a3b2-456f1b9f0177 req-020e5411-cfba-45e5-a8e8-23136ddffaf0 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:19.349438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 444/885] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:19 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:19.349587 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-89e15ae4-6948-4b1a-a3b2-456f1b9f0177 req-020e5411-cfba-45e5-a8e8-23136ddffaf0 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:19.368007 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-89e15ae4-6948-4b1a-a3b2-456f1b9f0177 req-020e5411-cfba-45e5-a8e8-23136ddffaf0 service nova] Creating event network-vif-deleted:5109bc3e-5bc8-407d-b0e7-4d3d700d2044 for instance 9e5636f2-5f2f-45ca-af8a-d998079502df on hv-cinder-85236 Sep 04 16:20:19.373805 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-89e15ae4-6948-4b1a-a3b2-456f1b9f0177 req-020e5411-cfba-45e5-a8e8-23136ddffaf0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039022 Sep 04 16:20:19.374394 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 442/886] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:20:19.424065 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-517a7599-7cd4-4cd8-87be-fe127cae18ad tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:19.424682 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-517a7599-7cd4-4cd8-87be-fe127cae18ad tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:19.430801 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-517a7599-7cd4-4cd8-87be-fe127cae18ad tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:19.431341 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-517a7599-7cd4-4cd8-87be-fe127cae18ad tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:19.431735 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-517a7599-7cd4-4cd8-87be-fe127cae18ad tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:19.432896 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-517a7599-7cd4-4cd8-87be-fe127cae18ad tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:19.432896 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-517a7599-7cd4-4cd8-87be-fe127cae18ad tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:19.433335 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-517a7599-7cd4-4cd8-87be-fe127cae18ad tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:19.441369 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4b754108-51c9-4445-a94c-fb3a1a5801cd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:19.442170 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4b754108-51c9-4445-a94c-fb3a1a5801cd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:19.448514 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4b754108-51c9-4445-a94c-fb3a1a5801cd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:19.449078 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4b754108-51c9-4445-a94c-fb3a1a5801cd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:19.449957 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4b754108-51c9-4445-a94c-fb3a1a5801cd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:19.450537 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4b754108-51c9-4445-a94c-fb3a1a5801cd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:19.451336 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4b754108-51c9-4445-a94c-fb3a1a5801cd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:19.451565 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4b754108-51c9-4445-a94c-fb3a1a5801cd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:19.643522 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-517a7599-7cd4-4cd8-87be-fe127cae18ad tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:19.652321 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-517a7599-7cd4-4cd8-87be-fe127cae18ad tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:19.654340 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-517a7599-7cd4-4cd8-87be-fe127cae18ad tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:19.655549 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-517a7599-7cd4-4cd8-87be-fe127cae18ad tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1724 microversion: 2.20 time: 0.235441 Sep 04 16:20:19.656121 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 445/887] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:19 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:19.672245 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4b754108-51c9-4445-a94c-fb3a1a5801cd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:19.682611 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-50bb5af8-546b-4222-8cd8-d0b3d53b7bac tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:19.683201 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-50bb5af8-546b-4222-8cd8-d0b3d53b7bac tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:19.690995 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50bb5af8-546b-4222-8cd8-d0b3d53b7bac tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:19.691340 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4b754108-51c9-4445-a94c-fb3a1a5801cd tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1521 microversion: 2.1 time: 0.253983 Sep 04 16:20:19.692317 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50bb5af8-546b-4222-8cd8-d0b3d53b7bac tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:19.692317 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50bb5af8-546b-4222-8cd8-d0b3d53b7bac tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:19.692685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50bb5af8-546b-4222-8cd8-d0b3d53b7bac tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:19.703086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50bb5af8-546b-4222-8cd8-d0b3d53b7bac tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:19.703086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-50bb5af8-546b-4222-8cd8-d0b3d53b7bac tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:19.703459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 443/888] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:19 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:19.773313 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1e15670e-aab4-4bb8-9e17-177656c50fc5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:19.774092 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1e15670e-aab4-4bb8-9e17-177656c50fc5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:19.780493 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1e15670e-aab4-4bb8-9e17-177656c50fc5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:19.781057 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1e15670e-aab4-4bb8-9e17-177656c50fc5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:19.781488 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1e15670e-aab4-4bb8-9e17-177656c50fc5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:19.782409 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1e15670e-aab4-4bb8-9e17-177656c50fc5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:19.783025 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1e15670e-aab4-4bb8-9e17-177656c50fc5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:19.783610 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1e15670e-aab4-4bb8-9e17-177656c50fc5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:19.896814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1e15670e-aab4-4bb8-9e17-177656c50fc5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:19.905055 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1e15670e-aab4-4bb8-9e17-177656c50fc5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1326 microversion: 2.1 time: 0.135991 Sep 04 16:20:19.905316 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-50bb5af8-546b-4222-8cd8-d0b3d53b7bac tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:19.905798 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 444/889] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:19 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1326 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:19.913641 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-50bb5af8-546b-4222-8cd8-d0b3d53b7bac tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1266 microversion: 2.1 time: 0.235379 Sep 04 16:20:19.914211 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 446/890] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:19 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:19.962002 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3abc63fb-e2d2-4b5f-84e8-7019a9329468 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:19.962693 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3abc63fb-e2d2-4b5f-84e8-7019a9329468 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:19.971296 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3abc63fb-e2d2-4b5f-84e8-7019a9329468 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:19.972492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3abc63fb-e2d2-4b5f-84e8-7019a9329468 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:19.973148 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3abc63fb-e2d2-4b5f-84e8-7019a9329468 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:19.974072 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3abc63fb-e2d2-4b5f-84e8-7019a9329468 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:19.974709 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3abc63fb-e2d2-4b5f-84e8-7019a9329468 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:19.975315 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3abc63fb-e2d2-4b5f-84e8-7019a9329468 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:20.352134 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3abc63fb-e2d2-4b5f-84e8-7019a9329468 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:20.362037 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3abc63fb-e2d2-4b5f-84e8-7019a9329468 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1757 microversion: 2.1 time: 0.405441 Sep 04 16:20:20.362621 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 445/891] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:19 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1757 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:20.373528 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0ed1bbd9-c661-40b9-b85c-bc70fd206a97 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:20.374260 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0ed1bbd9-c661-40b9-b85c-bc70fd206a97 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:20.380540 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ed1bbd9-c661-40b9-b85c-bc70fd206a97 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:20.381095 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ed1bbd9-c661-40b9-b85c-bc70fd206a97 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:20.381673 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ed1bbd9-c661-40b9-b85c-bc70fd206a97 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:20.382377 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ed1bbd9-c661-40b9-b85c-bc70fd206a97 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:20.383062 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ed1bbd9-c661-40b9-b85c-bc70fd206a97 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:20.383602 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0ed1bbd9-c661-40b9-b85c-bc70fd206a97 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:20.581271 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0ed1bbd9-c661-40b9-b85c-bc70fd206a97 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:20.589908 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0ed1bbd9-c661-40b9-b85c-bc70fd206a97 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1520 microversion: 2.1 time: 0.221564 Sep 04 16:20:20.591552 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 447/892] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:20 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:20.688952 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-bffbe1a7-7151-41aa-aff9-144ef59796a5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:20.689634 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-bffbe1a7-7151-41aa-aff9-144ef59796a5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:20.696520 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bffbe1a7-7151-41aa-aff9-144ef59796a5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:20.697078 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bffbe1a7-7151-41aa-aff9-144ef59796a5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:20.697523 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bffbe1a7-7151-41aa-aff9-144ef59796a5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:20.698245 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bffbe1a7-7151-41aa-aff9-144ef59796a5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:20.698696 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bffbe1a7-7151-41aa-aff9-144ef59796a5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:20.700495 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bffbe1a7-7151-41aa-aff9-144ef59796a5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:20.723610 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-289c6bc3-b5e7-4ef9-9376-b7b94f1c9cb8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:20.724229 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-289c6bc3-b5e7-4ef9-9376-b7b94f1c9cb8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:20.730348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-289c6bc3-b5e7-4ef9-9376-b7b94f1c9cb8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:20.732071 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-289c6bc3-b5e7-4ef9-9376-b7b94f1c9cb8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:20.732834 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-289c6bc3-b5e7-4ef9-9376-b7b94f1c9cb8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:20.733544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-289c6bc3-b5e7-4ef9-9376-b7b94f1c9cb8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:20.734050 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-289c6bc3-b5e7-4ef9-9376-b7b94f1c9cb8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:20.734481 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-289c6bc3-b5e7-4ef9-9376-b7b94f1c9cb8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:20.852985 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-289c6bc3-b5e7-4ef9-9376-b7b94f1c9cb8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:20.863725 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-289c6bc3-b5e7-4ef9-9376-b7b94f1c9cb8 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1479 microversion: 2.1 time: 0.145761 Sep 04 16:20:20.865302 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 448/893] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:20 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1479 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:20.928526 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f72573bf-b51b-4497-9a4b-aa2a40971604 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:20.929217 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f72573bf-b51b-4497-9a4b-aa2a40971604 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:20.936490 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f72573bf-b51b-4497-9a4b-aa2a40971604 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:20.937087 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f72573bf-b51b-4497-9a4b-aa2a40971604 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:20.937648 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f72573bf-b51b-4497-9a4b-aa2a40971604 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:20.938418 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f72573bf-b51b-4497-9a4b-aa2a40971604 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:20.938948 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f72573bf-b51b-4497-9a4b-aa2a40971604 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:20.939441 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f72573bf-b51b-4497-9a4b-aa2a40971604 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:20.955859 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bffbe1a7-7151-41aa-aff9-144ef59796a5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:20.963930 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bffbe1a7-7151-41aa-aff9-144ef59796a5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:20.965485 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bffbe1a7-7151-41aa-aff9-144ef59796a5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:20.967489 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-bffbe1a7-7151-41aa-aff9-144ef59796a5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1724 microversion: 2.20 time: 0.283084 Sep 04 16:20:20.968051 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 446/894] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:20 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1724 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:20.972783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-458fcc06-7bdc-40a1-895e-83b52dd4706b tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:20.973589 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-458fcc06-7bdc-40a1-895e-83b52dd4706b tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:20.978124 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f72573bf-b51b-4497-9a4b-aa2a40971604 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:20.978607 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f72573bf-b51b-4497-9a4b-aa2a40971604 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:20.979207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f72573bf-b51b-4497-9a4b-aa2a40971604 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:20.979654 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-f72573bf-b51b-4497-9a4b-aa2a40971604 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lazy-loading 'fault' on Instance uuid 9e5636f2-5f2f-45ca-af8a-d998079502df {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:20:20.980044 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-458fcc06-7bdc-40a1-895e-83b52dd4706b tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:20.980522 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-458fcc06-7bdc-40a1-895e-83b52dd4706b tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:20.980953 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-458fcc06-7bdc-40a1-895e-83b52dd4706b tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:20.982653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-458fcc06-7bdc-40a1-895e-83b52dd4706b tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:20.983297 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-458fcc06-7bdc-40a1-895e-83b52dd4706b tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:20.983731 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-458fcc06-7bdc-40a1-895e-83b52dd4706b tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:21.003482 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:20:21.026895 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f72573bf-b51b-4497-9a4b-aa2a40971604 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:21.037828 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f72573bf-b51b-4497-9a4b-aa2a40971604 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 200 len: 1331 microversion: 2.1 time: 0.113281 Sep 04 16:20:21.038505 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 449/895] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:20 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:21.131538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-458fcc06-7bdc-40a1-895e-83b52dd4706b tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:21.139338 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-458fcc06-7bdc-40a1-895e-83b52dd4706b tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1266 microversion: 2.1 time: 0.170129 Sep 04 16:20:21.139907 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 447/896] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:20 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:21.385906 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-389b4606-91ee-4fa9-8d58-ab4b2ef79f11 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:21.386595 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-389b4606-91ee-4fa9-8d58-ab4b2ef79f11 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:21.388273 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-31f28c2e-9c97-427f-86df-e83d405c7dec req-8d892451-8000-4f1c-880f-642181092647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee1afbcb-161b-4255-af5d-7aa20d2bf66f", "name": "network-vif-deleted", "tag": "9b25d6f3-c217-4ae7-8acc-96e8367604e3"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:20:21.393839 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-389b4606-91ee-4fa9-8d58-ab4b2ef79f11 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:21.394438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-389b4606-91ee-4fa9-8d58-ab4b2ef79f11 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:21.394770 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-389b4606-91ee-4fa9-8d58-ab4b2ef79f11 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:21.395470 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-389b4606-91ee-4fa9-8d58-ab4b2ef79f11 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:21.395926 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-389b4606-91ee-4fa9-8d58-ab4b2ef79f11 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:21.396928 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-389b4606-91ee-4fa9-8d58-ab4b2ef79f11 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:21.398566 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-31f28c2e-9c97-427f-86df-e83d405c7dec req-8d892451-8000-4f1c-880f-642181092647 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:21.399094 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-31f28c2e-9c97-427f-86df-e83d405c7dec req-8d892451-8000-4f1c-880f-642181092647 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:21.399524 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-31f28c2e-9c97-427f-86df-e83d405c7dec req-8d892451-8000-4f1c-880f-642181092647 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:21.411017 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-31f28c2e-9c97-427f-86df-e83d405c7dec req-8d892451-8000-4f1c-880f-642181092647 service nova] Creating event network-vif-deleted:9b25d6f3-c217-4ae7-8acc-96e8367604e3 for instance ee1afbcb-161b-4255-af5d-7aa20d2bf66f on hv-cinder-85236 Sep 04 16:20:21.416068 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-31f28c2e-9c97-427f-86df-e83d405c7dec req-8d892451-8000-4f1c-880f-642181092647 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031940 Sep 04 16:20:21.416660 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 448/897] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:20:21.549065 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-389b4606-91ee-4fa9-8d58-ab4b2ef79f11 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:21.557247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-389b4606-91ee-4fa9-8d58-ab4b2ef79f11 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1760 microversion: 2.1 time: 0.175257 Sep 04 16:20:21.557846 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 450/898] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:21 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1760 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:21.614004 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-21da36c7-1c44-4b3f-b561-1299ece73027 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:21.614693 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-21da36c7-1c44-4b3f-b561-1299ece73027 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:21.621375 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-21da36c7-1c44-4b3f-b561-1299ece73027 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:21.621945 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-21da36c7-1c44-4b3f-b561-1299ece73027 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:21.622381 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-21da36c7-1c44-4b3f-b561-1299ece73027 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:21.623060 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-21da36c7-1c44-4b3f-b561-1299ece73027 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:21.623503 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-21da36c7-1c44-4b3f-b561-1299ece73027 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:21.623927 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-21da36c7-1c44-4b3f-b561-1299ece73027 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:21.763342 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-21da36c7-1c44-4b3f-b561-1299ece73027 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:21.772105 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-21da36c7-1c44-4b3f-b561-1299ece73027 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1520 microversion: 2.1 time: 0.162100 Sep 04 16:20:21.772664 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 449/899] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:21 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:21.889423 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3ddb0ed0-2bf5-4a31-8df6-e4a7f92ee111 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:21.890071 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3ddb0ed0-2bf5-4a31-8df6-e4a7f92ee111 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:21.897076 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ddb0ed0-2bf5-4a31-8df6-e4a7f92ee111 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:21.897824 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ddb0ed0-2bf5-4a31-8df6-e4a7f92ee111 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:21.898261 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ddb0ed0-2bf5-4a31-8df6-e4a7f92ee111 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:21.898984 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ddb0ed0-2bf5-4a31-8df6-e4a7f92ee111 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:21.899429 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ddb0ed0-2bf5-4a31-8df6-e4a7f92ee111 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:21.899844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ddb0ed0-2bf5-4a31-8df6-e4a7f92ee111 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:21.932109 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ddb0ed0-2bf5-4a31-8df6-e4a7f92ee111 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:21.932669 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ddb0ed0-2bf5-4a31-8df6-e4a7f92ee111 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:21.932942 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3ddb0ed0-2bf5-4a31-8df6-e4a7f92ee111 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:21.933379 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-3ddb0ed0-2bf5-4a31-8df6-e4a7f92ee111 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lazy-loading 'fault' on Instance uuid ee1afbcb-161b-4255-af5d-7aa20d2bf66f {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:20:21.979350 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-3ddb0ed0-2bf5-4a31-8df6-e4a7f92ee111 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9d55c52717546b09d93d956a29f49a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb043a0ecad3466bbd5a5874126d2810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:21.987945 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3ddb0ed0-2bf5-4a31-8df6-e4a7f92ee111 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 200 len: 1312 microversion: 2.1 time: 0.103686 Sep 04 16:20:21.988504 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 451/900] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:21 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:21.993608 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ce9bc47f-06bd-4927-893f-adb31862fdb2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:21.994228 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ce9bc47f-06bd-4927-893f-adb31862fdb2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:22.009856 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ce9bc47f-06bd-4927-893f-adb31862fdb2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:22.010374 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ce9bc47f-06bd-4927-893f-adb31862fdb2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:22.011468 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ce9bc47f-06bd-4927-893f-adb31862fdb2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:22.012177 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ce9bc47f-06bd-4927-893f-adb31862fdb2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:22.013298 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ce9bc47f-06bd-4927-893f-adb31862fdb2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:22.013965 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ce9bc47f-06bd-4927-893f-adb31862fdb2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:22.062737 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0aaa802b-602a-4c1b-86c1-abdf89e3d130 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:22.063348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0aaa802b-602a-4c1b-86c1-abdf89e3d130 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:22.069654 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0aaa802b-602a-4c1b-86c1-abdf89e3d130 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:22.070235 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0aaa802b-602a-4c1b-86c1-abdf89e3d130 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:22.070678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0aaa802b-602a-4c1b-86c1-abdf89e3d130 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:22.071411 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0aaa802b-602a-4c1b-86c1-abdf89e3d130 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:22.071867 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0aaa802b-602a-4c1b-86c1-abdf89e3d130 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:22.072285 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0aaa802b-602a-4c1b-86c1-abdf89e3d130 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:22.086568 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-0aaa802b-602a-4c1b-86c1-abdf89e3d130 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] HTTP exception thrown: Instance 9e5636f2-5f2f-45ca-af8a-d998079502df could not be found. Sep 04 16:20:22.088222 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0aaa802b-602a-4c1b-86c1-abdf89e3d130 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Request method failure captured: Sep 04 16:20:22.088222 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df HTTP/1.1 Sep 04 16:20:22.088222 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:20:22.088222 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:20:22.088222 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:20:22.088222 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 04 16:20:22.088222 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:20:22.088222 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:20:22.088222 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:20:22.088222 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:20:22.088222 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFM7CEjNpb-xR3hPJMPQ-wsTXSagT7BYEktfOgtljHhzvAeE20V1mpt42r1aF9sMAbjmPPVeaP94mwlrfyovEVPw6ArC_YpgCrCSBFtvcpj7IAtQcwG53eIdKr17VLDw7eStXYQicK9SnKgixnRa-ofn7JvVLgTmHvsJ-_KcGiq48xm4 Sep 04 16:20:22.088222 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:20:22.088222 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:20:22.088222 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:20:22.088222 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:20:22.088222 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:20:22.088222 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:20:22.088222 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:20:22.088222 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:20:22.088222 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:20:22.088222 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:20:22.089678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1cc5ea4158344d5c8a35bc5783410620", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}] Sep 04 16:20:22.089678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:20:22.089678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:20:22.089678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:20:22.089678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:20:22.089678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:20:22.089678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:20:22.089678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: 6e5c22b631df4600b9f920120b67fc67 Sep 04 16:20:22.089678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:20:22.089678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: > Sep 04 16:20:22.089678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Instance 9e5636f2-5f2f-45ca-af8a-d998079502df could not be found. Sep 04 16:20:22.089678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'id': '9e5636f2-5f2f-45ca-af8a-d998079502df'} Sep 04 16:20:22.094172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:20:22.094172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:20:22.094172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:20:22.094172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:20:22.094172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:20:22.094172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:20:22.094172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:20:22.094172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:20:22.094172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:20:22.094172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:20:22.094172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e5636f2-5f2f-45ca-af8a-d998079502df could not be found. Sep 04 16:20:22.094172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:20:22.094172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:20:22.094172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:20:22.094172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:20:22.094172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:20:22.094172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:20:22.094172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:20:22.094172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:20:22.094172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:20:22.095643 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:20:22.095643 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:20:22.095643 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:20:22.095643 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:20:22.095643 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:20:22.095643 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:20:22.095643 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:20:22.095643 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e5636f2-5f2f-45ca-af8a-d998079502df could not be found. Sep 04 16:20:22.095643 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:20:22.095643 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:20:22.095643 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:20:22.095643 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:20:22.095643 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:20:22.095643 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:20:22.095643 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:20:22.095643 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:20:22.095643 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e5636f2-5f2f-45ca-af8a-d998079502df could not be found. Sep 04 16:20:22.095643 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:20:22.096960 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0aaa802b-602a-4c1b-86c1-abdf89e3d130 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Returning 404 to user: Instance 9e5636f2-5f2f-45ca-af8a-d998079502df could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:20:22.096960 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0aaa802b-602a-4c1b-86c1-abdf89e3d130 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 404 len: 111 microversion: 2.1 time: 0.031819 Sep 04 16:20:22.096960 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 452/901] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:22 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 04 16:20:22.098452 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-eb4e12b4-7385-44e2-ad56-ad8da8a8bf38 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '.version_select at 0x7f96890f0a60>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:22.153554 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ce9bc47f-06bd-4927-893f-adb31862fdb2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:22.162397 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ce9bc47f-06bd-4927-893f-adb31862fdb2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:22.163845 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ce9bc47f-06bd-4927-893f-adb31862fdb2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:22.164999 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ce9bc47f-06bd-4927-893f-adb31862fdb2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1745 microversion: 2.20 time: 0.175476 Sep 04 16:20:22.165689 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 450/902] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:21 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:20:22.170887 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-56586228-b703-4b30-a595-8e5c19ef3f74 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:22.171608 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-56586228-b703-4b30-a595-8e5c19ef3f74 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:22.177636 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-56586228-b703-4b30-a595-8e5c19ef3f74 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:22.178116 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-56586228-b703-4b30-a595-8e5c19ef3f74 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:22.178616 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-56586228-b703-4b30-a595-8e5c19ef3f74 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:22.179806 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-56586228-b703-4b30-a595-8e5c19ef3f74 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:22.180253 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-56586228-b703-4b30-a595-8e5c19ef3f74 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:22.180706 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-56586228-b703-4b30-a595-8e5c19ef3f74 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:22.180936 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-eb4e12b4-7385-44e2-ad56-ad8da8a8bf38 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-229059128" status: 202 len: 0 microversion: 2.1 time: 0.085834 Sep 04 16:20:22.181650 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 453/903] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Sep 4 16:20:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-229059128 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 04 16:20:22.389362 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-56586228-b703-4b30-a595-8e5c19ef3f74 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:22.397785 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-56586228-b703-4b30-a595-8e5c19ef3f74 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1266 microversion: 2.1 time: 0.231056 Sep 04 16:20:22.398441 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 451/904] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:22 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:22.796827 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-484fa893-e78a-4109-a89b-71edb16902c6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:22.797462 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-484fa893-e78a-4109-a89b-71edb16902c6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:22.803534 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-484fa893-e78a-4109-a89b-71edb16902c6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:22.804014 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-484fa893-e78a-4109-a89b-71edb16902c6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:22.804445 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-484fa893-e78a-4109-a89b-71edb16902c6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:22.805145 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-484fa893-e78a-4109-a89b-71edb16902c6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:22.805619 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-484fa893-e78a-4109-a89b-71edb16902c6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:22.806041 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-484fa893-e78a-4109-a89b-71edb16902c6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:22.826362 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:20:23.014823 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-185e6f4d-1cb9-4917-976c-b2ad0d67fe01 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:23.015465 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-185e6f4d-1cb9-4917-976c-b2ad0d67fe01 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] [instance: ee1afbcb-161b-4255-af5d-7aa20d2bf66f] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:23.022543 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-185e6f4d-1cb9-4917-976c-b2ad0d67fe01 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:23.023027 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-185e6f4d-1cb9-4917-976c-b2ad0d67fe01 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:23.023464 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-185e6f4d-1cb9-4917-976c-b2ad0d67fe01 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:23.024155 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-185e6f4d-1cb9-4917-976c-b2ad0d67fe01 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:23.024606 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-185e6f4d-1cb9-4917-976c-b2ad0d67fe01 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:23.025027 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-185e6f4d-1cb9-4917-976c-b2ad0d67fe01 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:23.039688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-185e6f4d-1cb9-4917-976c-b2ad0d67fe01 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] HTTP exception thrown: Instance ee1afbcb-161b-4255-af5d-7aa20d2bf66f could not be found. Sep 04 16:20:23.041345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-185e6f4d-1cb9-4917-976c-b2ad0d67fe01 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Request method failure captured: Sep 04 16:20:23.041345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f HTTP/1.1 Sep 04 16:20:23.041345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:20:23.041345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:20:23.041345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:20:23.041345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:20:23.041345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:20:23.041345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:20:23.041345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:20:23.041345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:20:23.041345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFM7AQu8qea0BFPhZJJD1SjpMjCb9OT3yqcZNamIbdv_2tiOBslm23HUMyFLRuEja9zOxHSb7HCyTIWbzZ5oqcjUZcQ0rElKr7qovko9hAD8HBN652TVbu8E6ygcWWlMFsAALAQQiHxyfrlUQj8PuQ9eIFVlDfwklsO4cKSYRuTyg9y4 Sep 04 16:20:23.041345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:20:23.041345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:20:23.041345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:20:23.041345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:20:23.041345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:20:23.041345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:20:23.041345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: cb043a0ecad3466bbd5a5874126d2810 Sep 04 16:20:23.041345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1718450479 Sep 04 16:20:23.041345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:20:23.041345 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:20:23.042949 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cb043a0ecad3466bbd5a5874126d2810"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb043a0ecad3466bbd5a5874126d2810"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cb043a0ecad3466bbd5a5874126d2810", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cb043a0ecad3466bbd5a5874126d2810"}]}] Sep 04 16:20:23.042949 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1718450479 Sep 04 16:20:23.042949 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: cb043a0ecad3466bbd5a5874126d2810 Sep 04 16:20:23.042949 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1718450479 Sep 04 16:20:23.042949 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-ServerRescueNegativeTestJSON-1718450479-project Sep 04 16:20:23.042949 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:20:23.042949 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:20:23.042949 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: a9d55c52717546b09d93d956a29f49a9 Sep 04 16:20:23.042949 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1718450479-project Sep 04 16:20:23.042949 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: > Sep 04 16:20:23.042949 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Instance ee1afbcb-161b-4255-af5d-7aa20d2bf66f could not be found. Sep 04 16:20:23.042949 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': 'ee1afbcb-161b-4255-af5d-7aa20d2bf66f'} Sep 04 16:20:23.043961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:20:23.043961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:20:23.043961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:20:23.043961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:20:23.043961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:20:23.043961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:20:23.043961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:20:23.043961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:20:23.043961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:20:23.043961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:20:23.043961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee1afbcb-161b-4255-af5d-7aa20d2bf66f could not be found. Sep 04 16:20:23.043961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:20:23.043961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:20:23.043961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:20:23.043961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:20:23.043961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:20:23.043961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:20:23.043961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:20:23.043961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:20:23.043961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:20:23.045214 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:20:23.045214 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:20:23.045214 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:20:23.045214 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:20:23.045214 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:20:23.045214 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:20:23.045214 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:20:23.045214 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee1afbcb-161b-4255-af5d-7aa20d2bf66f could not be found. Sep 04 16:20:23.045214 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:20:23.045214 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:20:23.045214 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:20:23.045214 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:20:23.045214 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:20:23.045214 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:20:23.045214 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:20:23.045214 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:20:23.045214 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee1afbcb-161b-4255-af5d-7aa20d2bf66f could not be found. Sep 04 16:20:23.045214 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:20:23.047742 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-185e6f4d-1cb9-4917-976c-b2ad0d67fe01 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] Returning 404 to user: Instance ee1afbcb-161b-4255-af5d-7aa20d2bf66f could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:20:23.047742 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-185e6f4d-1cb9-4917-976c-b2ad0d67fe01 tempest-ServerRescueNegativeTestJSON-1718450479 tempest-ServerRescueNegativeTestJSON-1718450479-project] 10.222.0.39 "GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f" status: 404 len: 111 microversion: 2.1 time: 0.032425 Sep 04 16:20:23.047742 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 452/905] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:23 2022] GET /compute/v2.1/servers/ee1afbcb-161b-4255-af5d-7aa20d2bf66f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 04 16:20:23.068512 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-484fa893-e78a-4109-a89b-71edb16902c6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:23.077996 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-484fa893-e78a-4109-a89b-71edb16902c6 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1576 microversion: 2.1 time: 0.286600 Sep 04 16:20:23.078699 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 454/906] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:22 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1576 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:23.192630 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7ce40b8c-3224-45f3-9819-72bd027e64f1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:23.193267 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7ce40b8c-3224-45f3-9819-72bd027e64f1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:23.199760 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ce40b8c-3224-45f3-9819-72bd027e64f1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:23.200480 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ce40b8c-3224-45f3-9819-72bd027e64f1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:23.200916 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ce40b8c-3224-45f3-9819-72bd027e64f1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:23.201640 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ce40b8c-3224-45f3-9819-72bd027e64f1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:23.202091 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ce40b8c-3224-45f3-9819-72bd027e64f1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:23.202509 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7ce40b8c-3224-45f3-9819-72bd027e64f1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:23.256569 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-33a53432-11ed-4a47-9af8-65a4c98d3841 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Action: 'create', calling method: .version_select at 0x7f96891add30>, body: {"keypair": {"name": "tempest-keypair-234402332", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDm5GvCH+wJbMbgRe+t0iKd6plnB2bn/yY/wz4fcIP9EOLBrVmbYkVZUGD9LYj7C9mWs5KtfUfZ9gS/bq5zlVNOfliQIhD2L6xzA+xjHCVZ+I8F8SHaicfREPHz/BRZA5w=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:20:23.273017 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-33a53432-11ed-4a47-9af8-65a4c98d3841 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Getting quotas for project 1cc5ea4158344d5c8a35bc5783410620. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:20:23.277531 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-33a53432-11ed-4a47-9af8-65a4c98d3841 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Getting quotas for user 6e5c22b631df4600b9f920120b67fc67 and project 1cc5ea4158344d5c8a35bc5783410620. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:20:23.384527 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-33a53432-11ed-4a47-9af8-65a4c98d3841 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.131898 Sep 04 16:20:23.385591 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 455/907] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Sep 4 16:20:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:20:23.422005 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-23ce404b-56a8-4ebc-9c9f-7cc565b9765e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:23.422870 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-23ce404b-56a8-4ebc-9c9f-7cc565b9765e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:23.431768 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7ce40b8c-3224-45f3-9819-72bd027e64f1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:23.436193 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23ce404b-56a8-4ebc-9c9f-7cc565b9765e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:23.436978 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23ce404b-56a8-4ebc-9c9f-7cc565b9765e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:23.437633 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23ce404b-56a8-4ebc-9c9f-7cc565b9765e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:23.438525 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23ce404b-56a8-4ebc-9c9f-7cc565b9765e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:23.438978 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23ce404b-56a8-4ebc-9c9f-7cc565b9765e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:23.439399 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-23ce404b-56a8-4ebc-9c9f-7cc565b9765e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:23.443421 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7ce40b8c-3224-45f3-9819-72bd027e64f1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:23.445412 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7ce40b8c-3224-45f3-9819-72bd027e64f1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:23.446741 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7ce40b8c-3224-45f3-9819-72bd027e64f1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1745 microversion: 2.20 time: 0.258469 Sep 04 16:20:23.447535 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 453/908] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:23 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1745 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:23.686707 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-23ce404b-56a8-4ebc-9c9f-7cc565b9765e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:23.695903 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-23ce404b-56a8-4ebc-9c9f-7cc565b9765e tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1266 microversion: 2.1 time: 0.277619 Sep 04 16:20:23.712181 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 456/909] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:23 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1266 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:24.107782 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-759c4aae-ef8d-44dd-9cc2-0e42434043ba tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:24.112095 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-759c4aae-ef8d-44dd-9cc2-0e42434043ba tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:24.116185 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-759c4aae-ef8d-44dd-9cc2-0e42434043ba tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:24.116674 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-759c4aae-ef8d-44dd-9cc2-0e42434043ba tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:24.117101 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-759c4aae-ef8d-44dd-9cc2-0e42434043ba tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:24.117913 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-759c4aae-ef8d-44dd-9cc2-0e42434043ba tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:24.118559 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-759c4aae-ef8d-44dd-9cc2-0e42434043ba tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:24.118980 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-759c4aae-ef8d-44dd-9cc2-0e42434043ba tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:24.473788 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fdec6b1a-9811-4600-87da-cf176cf4c21a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:24.474634 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fdec6b1a-9811-4600-87da-cf176cf4c21a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:24.497247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdec6b1a-9811-4600-87da-cf176cf4c21a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:24.497928 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdec6b1a-9811-4600-87da-cf176cf4c21a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:24.498334 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdec6b1a-9811-4600-87da-cf176cf4c21a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:24.499100 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdec6b1a-9811-4600-87da-cf176cf4c21a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:24.499563 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdec6b1a-9811-4600-87da-cf176cf4c21a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:24.499994 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fdec6b1a-9811-4600-87da-cf176cf4c21a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:24.679176 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-759c4aae-ef8d-44dd-9cc2-0e42434043ba tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:24.696312 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-759c4aae-ef8d-44dd-9cc2-0e42434043ba tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1576 microversion: 2.1 time: 0.592547 Sep 04 16:20:24.710044 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 454/910] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:24 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1576 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:24.719691 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-84598505-07ea-4963-8fb2-6fdf09c903da tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:24.720311 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-84598505-07ea-4963-8fb2-6fdf09c903da tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:24.735536 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-84598505-07ea-4963-8fb2-6fdf09c903da tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:24.735536 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-84598505-07ea-4963-8fb2-6fdf09c903da tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:24.735536 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-84598505-07ea-4963-8fb2-6fdf09c903da tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:24.735536 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-84598505-07ea-4963-8fb2-6fdf09c903da tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:24.735877 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-84598505-07ea-4963-8fb2-6fdf09c903da tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:24.735877 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-84598505-07ea-4963-8fb2-6fdf09c903da tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:24.850070 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-fdec6b1a-9811-4600-87da-cf176cf4c21a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:24.869925 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-fdec6b1a-9811-4600-87da-cf176cf4c21a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:24.872193 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-fdec6b1a-9811-4600-87da-cf176cf4c21a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:24.874478 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fdec6b1a-9811-4600-87da-cf176cf4c21a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1740 microversion: 2.20 time: 0.405091 Sep 04 16:20:24.875407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 457/911] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:24 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1740 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:20:25.006057 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-84598505-07ea-4963-8fb2-6fdf09c903da tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:25.020835 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-84598505-07ea-4963-8fb2-6fdf09c903da tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1266 microversion: 2.1 time: 0.305216 Sep 04 16:20:25.037632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 455/912] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:24 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:25.722810 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6338b7b5-bd52-4b18-9c04-d9988cb899af tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:25.724174 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6338b7b5-bd52-4b18-9c04-d9988cb899af tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:25.743181 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6338b7b5-bd52-4b18-9c04-d9988cb899af tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:25.745337 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6338b7b5-bd52-4b18-9c04-d9988cb899af tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:25.750292 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6338b7b5-bd52-4b18-9c04-d9988cb899af tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:25.751396 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6338b7b5-bd52-4b18-9c04-d9988cb899af tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:25.752365 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6338b7b5-bd52-4b18-9c04-d9988cb899af tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:25.753032 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6338b7b5-bd52-4b18-9c04-d9988cb899af tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:25.907940 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ba063667-6a03-4169-952b-c38aabd9cd1c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:25.909595 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ba063667-6a03-4169-952b-c38aabd9cd1c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:25.931716 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba063667-6a03-4169-952b-c38aabd9cd1c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:25.934498 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba063667-6a03-4169-952b-c38aabd9cd1c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:25.937525 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba063667-6a03-4169-952b-c38aabd9cd1c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:25.941460 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba063667-6a03-4169-952b-c38aabd9cd1c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:25.944168 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba063667-6a03-4169-952b-c38aabd9cd1c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:25.946714 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba063667-6a03-4169-952b-c38aabd9cd1c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:26.598968 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-6338b7b5-bd52-4b18-9c04-d9988cb899af tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:26.620905 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6338b7b5-bd52-4b18-9c04-d9988cb899af tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1576 microversion: 2.1 time: 0.898082 Sep 04 16:20:26.641513 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 458/913] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:25 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1576 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:26.656506 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9b77ac6f-0998-4a38-926d-b7c31146dcfb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:26.657751 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9b77ac6f-0998-4a38-926d-b7c31146dcfb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:26.691070 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b77ac6f-0998-4a38-926d-b7c31146dcfb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:26.691787 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b77ac6f-0998-4a38-926d-b7c31146dcfb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:26.698981 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b77ac6f-0998-4a38-926d-b7c31146dcfb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:26.700135 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b77ac6f-0998-4a38-926d-b7c31146dcfb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:26.701398 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b77ac6f-0998-4a38-926d-b7c31146dcfb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:26.702270 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b77ac6f-0998-4a38-926d-b7c31146dcfb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:26.724808 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ba063667-6a03-4169-952b-c38aabd9cd1c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:26.734720 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ba063667-6a03-4169-952b-c38aabd9cd1c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:26.738557 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ba063667-6a03-4169-952b-c38aabd9cd1c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:26.739773 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ba063667-6a03-4169-952b-c38aabd9cd1c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1740 microversion: 2.20 time: 0.836410 Sep 04 16:20:26.742660 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 456/914] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:25 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1740 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:26.749212 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-00eade25-9c42-44c4-aab8-a0446f138e0c req-7b1e0def-320d-40c1-88a2-d629b20f00b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73", "name": "network-vif-plugged", "status": "completed", "tag": "6d210ca9-1ff4-4f3e-842e-652e252e69a7"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:20:26.769309 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-00eade25-9c42-44c4-aab8-a0446f138e0c req-7b1e0def-320d-40c1-88a2-d629b20f00b0 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:26.770484 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-00eade25-9c42-44c4-aab8-a0446f138e0c req-7b1e0def-320d-40c1-88a2-d629b20f00b0 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:26.771154 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-00eade25-9c42-44c4-aab8-a0446f138e0c req-7b1e0def-320d-40c1-88a2-d629b20f00b0 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:26.790953 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-00eade25-9c42-44c4-aab8-a0446f138e0c req-7b1e0def-320d-40c1-88a2-d629b20f00b0 service nova] Creating event network-vif-plugged:6d210ca9-1ff4-4f3e-842e-652e252e69a7 for instance ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 on hv-cinder-85236 Sep 04 16:20:26.798955 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-00eade25-9c42-44c4-aab8-a0446f138e0c req-7b1e0def-320d-40c1-88a2-d629b20f00b0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054466 Sep 04 16:20:26.800102 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 457/915] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:20:27.139820 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-9b77ac6f-0998-4a38-926d-b7c31146dcfb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:27.152821 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9b77ac6f-0998-4a38-926d-b7c31146dcfb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1266 microversion: 2.1 time: 0.509742 Sep 04 16:20:27.153806 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 459/916] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:26 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1266 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:27.594219 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9b3c296c-c036-45cc-baa3-d29c3c4068b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-818625127", "imageRef": "11a460f6-29b0-46e6-ae98-e53ee2e13520", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1fe4af06-d7bb-4218-9bf8-f19072fe6b17"}], "security_groups": [{"name": "tempest-securitygroup--2112901889"}], "key_name": "tempest-keypair-234402332", "user_data": "}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:20:27.657741 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d64319f6-cea5-40ac-972c-876feaf49183 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:27.660303 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d64319f6-cea5-40ac-972c-876feaf49183 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:27.669414 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d64319f6-cea5-40ac-972c-876feaf49183 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:27.672858 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d64319f6-cea5-40ac-972c-876feaf49183 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:27.673368 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d64319f6-cea5-40ac-972c-876feaf49183 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:27.674390 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d64319f6-cea5-40ac-972c-876feaf49183 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:27.677105 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d64319f6-cea5-40ac-972c-876feaf49183 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:27.678061 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d64319f6-cea5-40ac-972c-876feaf49183 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:27.745915 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-9b3c296c-c036-45cc-baa3-d29c3c4068b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] validate_networks() for [('1fe4af06-d7bb-4218-9bf8-f19072fe6b17', None, None, None, None, None)] {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 16:20:27.993021 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d64319f6-cea5-40ac-972c-876feaf49183 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:28.015486 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d64319f6-cea5-40ac-972c-876feaf49183 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1576 microversion: 2.1 time: 0.369577 Sep 04 16:20:28.037850 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 460/917] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:27 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1576 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:28.048059 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7062eb6e-8517-45ef-90e6-82c33bf60ce5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:28.052850 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7062eb6e-8517-45ef-90e6-82c33bf60ce5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:28.066118 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7062eb6e-8517-45ef-90e6-82c33bf60ce5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:28.069602 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7062eb6e-8517-45ef-90e6-82c33bf60ce5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:28.084026 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7062eb6e-8517-45ef-90e6-82c33bf60ce5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:28.084026 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7062eb6e-8517-45ef-90e6-82c33bf60ce5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:28.084026 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7062eb6e-8517-45ef-90e6-82c33bf60ce5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:28.084026 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7062eb6e-8517-45ef-90e6-82c33bf60ce5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:28.346996 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7062eb6e-8517-45ef-90e6-82c33bf60ce5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:28.356781 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7062eb6e-8517-45ef-90e6-82c33bf60ce5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:28.358961 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7062eb6e-8517-45ef-90e6-82c33bf60ce5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:28.366100 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7062eb6e-8517-45ef-90e6-82c33bf60ce5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1740 microversion: 2.20 time: 0.321001 Sep 04 16:20:28.366100 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 461/918] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:28 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1740 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:28.376467 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0c3fc947-74c8-4191-aa4e-226488b72a2f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:28.386665 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0c3fc947-74c8-4191-aa4e-226488b72a2f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:28.396711 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c3fc947-74c8-4191-aa4e-226488b72a2f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:28.397751 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c3fc947-74c8-4191-aa4e-226488b72a2f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:28.398621 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c3fc947-74c8-4191-aa4e-226488b72a2f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:28.399500 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c3fc947-74c8-4191-aa4e-226488b72a2f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:28.400108 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c3fc947-74c8-4191-aa4e-226488b72a2f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:28.400676 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c3fc947-74c8-4191-aa4e-226488b72a2f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:28.554432 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-9b3c296c-c036-45cc-baa3-d29c3c4068b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 16:20:28.555052 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-9b3c296c-c036-45cc-baa3-d29c3c4068b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 16:20:28.555705 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-9b3c296c-c036-45cc-baa3-d29c3c4068b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 16:20:28.557049 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-9b3c296c-c036-45cc-baa3-d29c3c4068b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 16:20:28.558290 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-9b3c296c-c036-45cc-baa3-d29c3c4068b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 16:20:28.584904 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9b3c296c-c036-45cc-baa3-d29c3c4068b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:28.585683 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9b3c296c-c036-45cc-baa3-d29c3c4068b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:28.586962 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9b3c296c-c036-45cc-baa3-d29c3c4068b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:28.587877 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9b3c296c-c036-45cc-baa3-d29c3c4068b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:28.590891 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9b3c296c-c036-45cc-baa3-d29c3c4068b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:28.592913 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9b3c296c-c036-45cc-baa3-d29c3c4068b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:28.621238 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-9b3c296c-c036-45cc-baa3-d29c3c4068b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Getting quotas for project 1cc5ea4158344d5c8a35bc5783410620. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:20:28.626830 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0c3fc947-74c8-4191-aa4e-226488b72a2f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:28.629054 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-9b3c296c-c036-45cc-baa3-d29c3c4068b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Getting quotas for user 6e5c22b631df4600b9f920120b67fc67 and project 1cc5ea4158344d5c8a35bc5783410620. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:20:28.637299 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0c3fc947-74c8-4191-aa4e-226488b72a2f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1266 microversion: 2.1 time: 0.271359 Sep 04 16:20:28.644543 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 462/919] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:28 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:28.645316 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9b3c296c-c036-45cc-baa3-d29c3c4068b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 16:20:28.648174 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9b3c296c-c036-45cc-baa3-d29c3c4068b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a460f6-29b0-46e6-ae98-e53ee2e13520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 16:20:28.844179 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9b3c296c-c036-45cc-baa3-d29c3c4068b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.267646 Sep 04 16:20:28.852319 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 458/920] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Sep 4 16:20:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 1278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 16:20:28.856783 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c510c161-1b6b-4784-809d-436612e9d098 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:28.857895 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c510c161-1b6b-4784-809d-436612e9d098 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:28.956764 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c510c161-1b6b-4784-809d-436612e9d098 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:28.971743 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c510c161-1b6b-4784-809d-436612e9d098 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4" status: 200 len: 1240 microversion: 2.1 time: 0.112973 Sep 04 16:20:28.978186 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 463/921] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:28 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 => generated 1240 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:29.041857 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ec444660-0e4e-4eb9-851a-11321f7da6a0 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:29.047271 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ec444660-0e4e-4eb9-851a-11321f7da6a0 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:29.047271 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=94,nova_api:INSERT=3 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:20:29.064614 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec444660-0e4e-4eb9-851a-11321f7da6a0 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:29.065120 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec444660-0e4e-4eb9-851a-11321f7da6a0 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:29.065583 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec444660-0e4e-4eb9-851a-11321f7da6a0 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:29.066312 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec444660-0e4e-4eb9-851a-11321f7da6a0 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:29.066771 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec444660-0e4e-4eb9-851a-11321f7da6a0 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:29.071137 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec444660-0e4e-4eb9-851a-11321f7da6a0 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:29.290207 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ec444660-0e4e-4eb9-851a-11321f7da6a0 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:29.299585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ec444660-0e4e-4eb9-851a-11321f7da6a0 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1576 microversion: 2.1 time: 0.262530 Sep 04 16:20:29.300165 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 459/922] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:29 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1576 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:29.397718 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-125ced14-13a6-40b3-b9a5-6403ec12529a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:29.397718 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-125ced14-13a6-40b3-b9a5-6403ec12529a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:29.400349 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-125ced14-13a6-40b3-b9a5-6403ec12529a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:29.400898 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-125ced14-13a6-40b3-b9a5-6403ec12529a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:29.401345 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-125ced14-13a6-40b3-b9a5-6403ec12529a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:29.402461 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-125ced14-13a6-40b3-b9a5-6403ec12529a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:29.402929 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-125ced14-13a6-40b3-b9a5-6403ec12529a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:29.403343 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-125ced14-13a6-40b3-b9a5-6403ec12529a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:29.533075 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-125ced14-13a6-40b3-b9a5-6403ec12529a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:29.541798 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-125ced14-13a6-40b3-b9a5-6403ec12529a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:29.543529 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-125ced14-13a6-40b3-b9a5-6403ec12529a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:29.544939 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-125ced14-13a6-40b3-b9a5-6403ec12529a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1740 microversion: 2.20 time: 0.156850 Sep 04 16:20:29.546515 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 464/923] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:29 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:29.660903 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-54aa7fb5-aa87-472d-a3fd-eca3d74b9a5f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:29.661745 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-54aa7fb5-aa87-472d-a3fd-eca3d74b9a5f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:29.681395 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54aa7fb5-aa87-472d-a3fd-eca3d74b9a5f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:29.682029 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54aa7fb5-aa87-472d-a3fd-eca3d74b9a5f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:29.683331 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54aa7fb5-aa87-472d-a3fd-eca3d74b9a5f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:29.683688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54aa7fb5-aa87-472d-a3fd-eca3d74b9a5f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:29.684210 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54aa7fb5-aa87-472d-a3fd-eca3d74b9a5f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:29.684700 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-54aa7fb5-aa87-472d-a3fd-eca3d74b9a5f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:29.877131 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-54aa7fb5-aa87-472d-a3fd-eca3d74b9a5f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:29.886057 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-54aa7fb5-aa87-472d-a3fd-eca3d74b9a5f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1266 microversion: 2.1 time: 0.229342 Sep 04 16:20:29.886616 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 460/924] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:29 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:29.990868 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-323d2dba-9bf6-4cad-bac4-95f40f2694d5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:29.991475 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-323d2dba-9bf6-4cad-bac4-95f40f2694d5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:30.087679 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-323d2dba-9bf6-4cad-bac4-95f40f2694d5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:30.096736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-323d2dba-9bf6-4cad-bac4-95f40f2694d5 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4" status: 200 len: 1240 microversion: 2.1 time: 0.109630 Sep 04 16:20:30.099931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 465/925] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:29 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 => generated 1240 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:30.325392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-26f42b64-935e-4b0b-b05b-6177b63f7c18 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:30.327405 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-26f42b64-935e-4b0b-b05b-6177b63f7c18 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:30.336065 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26f42b64-935e-4b0b-b05b-6177b63f7c18 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:30.336937 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26f42b64-935e-4b0b-b05b-6177b63f7c18 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:30.337772 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26f42b64-935e-4b0b-b05b-6177b63f7c18 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:30.338666 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26f42b64-935e-4b0b-b05b-6177b63f7c18 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:30.339383 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26f42b64-935e-4b0b-b05b-6177b63f7c18 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:30.339971 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26f42b64-935e-4b0b-b05b-6177b63f7c18 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:30.547251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-26f42b64-935e-4b0b-b05b-6177b63f7c18 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:30.562884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-26f42b64-935e-4b0b-b05b-6177b63f7c18 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1576 microversion: 2.1 time: 0.239973 Sep 04 16:20:30.565325 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 461/926] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:30 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1576 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:30.573128 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5e61bb21-ade4-4a97-9529-4ee4c807ae9c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:30.574313 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5e61bb21-ade4-4a97-9529-4ee4c807ae9c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:30.582355 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e61bb21-ade4-4a97-9529-4ee4c807ae9c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:30.588359 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e61bb21-ade4-4a97-9529-4ee4c807ae9c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:30.588359 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e61bb21-ade4-4a97-9529-4ee4c807ae9c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:30.588359 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e61bb21-ade4-4a97-9529-4ee4c807ae9c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:30.588359 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e61bb21-ade4-4a97-9529-4ee4c807ae9c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:30.588825 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5e61bb21-ade4-4a97-9529-4ee4c807ae9c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:30.786021 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5e61bb21-ade4-4a97-9529-4ee4c807ae9c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:30.797112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5e61bb21-ade4-4a97-9529-4ee4c807ae9c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:30.798583 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5e61bb21-ade4-4a97-9529-4ee4c807ae9c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:30.800276 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5e61bb21-ade4-4a97-9529-4ee4c807ae9c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1740 microversion: 2.20 time: 0.231193 Sep 04 16:20:30.811346 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 466/927] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:30 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1740 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:30.912274 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7f5af44e-b2ec-46db-bdbe-634594871a9d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:30.912876 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7f5af44e-b2ec-46db-bdbe-634594871a9d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:30.924377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7f5af44e-b2ec-46db-bdbe-634594871a9d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:30.924864 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7f5af44e-b2ec-46db-bdbe-634594871a9d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:30.931362 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7f5af44e-b2ec-46db-bdbe-634594871a9d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:30.932140 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7f5af44e-b2ec-46db-bdbe-634594871a9d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:30.932609 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7f5af44e-b2ec-46db-bdbe-634594871a9d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:30.933042 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7f5af44e-b2ec-46db-bdbe-634594871a9d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:31.126092 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e404ab9a-b081-4a69-b248-a8ddbe186932 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:31.126700 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e404ab9a-b081-4a69-b248-a8ddbe186932 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:31.149615 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:20:31.151425 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e404ab9a-b081-4a69-b248-a8ddbe186932 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:31.154417 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e404ab9a-b081-4a69-b248-a8ddbe186932 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:31.155037 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e404ab9a-b081-4a69-b248-a8ddbe186932 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:31.157465 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e404ab9a-b081-4a69-b248-a8ddbe186932 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:31.159545 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e404ab9a-b081-4a69-b248-a8ddbe186932 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:31.161176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e404ab9a-b081-4a69-b248-a8ddbe186932 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:31.329837 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e404ab9a-b081-4a69-b248-a8ddbe186932 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:31.336204 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e404ab9a-b081-4a69-b248-a8ddbe186932 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4" status: 200 len: 1292 microversion: 2.1 time: 0.214732 Sep 04 16:20:31.341393 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7f5af44e-b2ec-46db-bdbe-634594871a9d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:31.352257 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 467/928] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:31 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 => generated 1292 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:31.354378 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7f5af44e-b2ec-46db-bdbe-634594871a9d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1266 microversion: 2.1 time: 0.444659 Sep 04 16:20:31.355341 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 462/929] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:30 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1266 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:31.584207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-02741da2-d3bf-4d73-ae9d-f10187f1a11c tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:31.584820 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-02741da2-d3bf-4d73-ae9d-f10187f1a11c tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:31.602531 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02741da2-d3bf-4d73-ae9d-f10187f1a11c tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:31.603319 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02741da2-d3bf-4d73-ae9d-f10187f1a11c tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:31.603924 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02741da2-d3bf-4d73-ae9d-f10187f1a11c tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:31.604797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02741da2-d3bf-4d73-ae9d-f10187f1a11c tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:31.605412 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02741da2-d3bf-4d73-ae9d-f10187f1a11c tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:31.606031 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02741da2-d3bf-4d73-ae9d-f10187f1a11c tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:31.761078 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-02741da2-d3bf-4d73-ae9d-f10187f1a11c tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:31.774160 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-02741da2-d3bf-4d73-ae9d-f10187f1a11c tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1576 microversion: 2.1 time: 0.191292 Sep 04 16:20:31.774160 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 468/930] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:31 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1576 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:31.828880 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3ed55b86-6c60-46de-9e60-e2518fddfb64 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:31.829794 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3ed55b86-6c60-46de-9e60-e2518fddfb64 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:31.844982 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3ed55b86-6c60-46de-9e60-e2518fddfb64 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:31.844982 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3ed55b86-6c60-46de-9e60-e2518fddfb64 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:31.844982 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3ed55b86-6c60-46de-9e60-e2518fddfb64 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:31.844982 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3ed55b86-6c60-46de-9e60-e2518fddfb64 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:31.845508 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3ed55b86-6c60-46de-9e60-e2518fddfb64 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:31.845508 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3ed55b86-6c60-46de-9e60-e2518fddfb64 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:32.037513 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3ed55b86-6c60-46de-9e60-e2518fddfb64 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:32.047652 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3ed55b86-6c60-46de-9e60-e2518fddfb64 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:32.054285 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3ed55b86-6c60-46de-9e60-e2518fddfb64 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:32.057196 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3ed55b86-6c60-46de-9e60-e2518fddfb64 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1740 microversion: 2.20 time: 0.232948 Sep 04 16:20:32.062950 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 463/931] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:31 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1740 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:32.361031 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1f20bbc8-4e79-496d-810d-6992ecb1a422 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:32.361704 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1f20bbc8-4e79-496d-810d-6992ecb1a422 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:32.371148 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f20bbc8-4e79-496d-810d-6992ecb1a422 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:32.372970 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f20bbc8-4e79-496d-810d-6992ecb1a422 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:32.375396 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f20bbc8-4e79-496d-810d-6992ecb1a422 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:32.375396 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f20bbc8-4e79-496d-810d-6992ecb1a422 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:32.381041 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f20bbc8-4e79-496d-810d-6992ecb1a422 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:32.381628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-04e53ef7-ff09-4c2f-978d-143b45b96a21 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:32.381785 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1f20bbc8-4e79-496d-810d-6992ecb1a422 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:32.387662 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-04e53ef7-ff09-4c2f-978d-143b45b96a21 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:32.400206 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-04e53ef7-ff09-4c2f-978d-143b45b96a21 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:32.400735 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-04e53ef7-ff09-4c2f-978d-143b45b96a21 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:32.401174 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-04e53ef7-ff09-4c2f-978d-143b45b96a21 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:32.406597 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-04e53ef7-ff09-4c2f-978d-143b45b96a21 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:32.407143 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-04e53ef7-ff09-4c2f-978d-143b45b96a21 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:32.410969 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-04e53ef7-ff09-4c2f-978d-143b45b96a21 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:32.547258 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1f20bbc8-4e79-496d-810d-6992ecb1a422 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:32.557295 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1f20bbc8-4e79-496d-810d-6992ecb1a422 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4" status: 200 len: 1310 microversion: 2.1 time: 0.200492 Sep 04 16:20:32.569859 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 469/932] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:32 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 => generated 1310 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:32.722908 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-04e53ef7-ff09-4c2f-978d-143b45b96a21 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:32.731370 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-04e53ef7-ff09-4c2f-978d-143b45b96a21 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1266 microversion: 2.1 time: 0.354407 Sep 04 16:20:32.732475 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 464/933] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:32 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1266 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:32.796467 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4e18135c-8cc5-4c80-a4ef-a1d46c5b96cb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:32.797731 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4e18135c-8cc5-4c80-a4ef-a1d46c5b96cb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:32.809581 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e18135c-8cc5-4c80-a4ef-a1d46c5b96cb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:32.810113 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e18135c-8cc5-4c80-a4ef-a1d46c5b96cb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:32.810528 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e18135c-8cc5-4c80-a4ef-a1d46c5b96cb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:32.812231 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e18135c-8cc5-4c80-a4ef-a1d46c5b96cb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:32.812694 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e18135c-8cc5-4c80-a4ef-a1d46c5b96cb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:32.813122 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4e18135c-8cc5-4c80-a4ef-a1d46c5b96cb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:32.857365 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-ad0bfaf5-a6b9-4249-a364-74857280fa4d req-19b8088d-38a8-45ff-8469-1c6481f3fb4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c65f38-de9c-4de3-8cf5-92147eb37728", "name": "network-vif-plugged", "status": "completed", "tag": "329a6f01-f405-46c1-8565-cde5c89b347e"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:20:32.878785 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-ad0bfaf5-a6b9-4249-a364-74857280fa4d req-19b8088d-38a8-45ff-8469-1c6481f3fb4c service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:32.884353 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-ad0bfaf5-a6b9-4249-a364-74857280fa4d req-19b8088d-38a8-45ff-8469-1c6481f3fb4c service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:32.884353 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-ad0bfaf5-a6b9-4249-a364-74857280fa4d req-19b8088d-38a8-45ff-8469-1c6481f3fb4c service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:32.892457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-ad0bfaf5-a6b9-4249-a364-74857280fa4d req-19b8088d-38a8-45ff-8469-1c6481f3fb4c service nova] Creating event network-vif-plugged:329a6f01-f405-46c1-8565-cde5c89b347e for instance 04c65f38-de9c-4de3-8cf5-92147eb37728 on hv-cinder-85236 Sep 04 16:20:32.898456 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-ad0bfaf5-a6b9-4249-a364-74857280fa4d req-19b8088d-38a8-45ff-8469-1c6481f3fb4c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045651 Sep 04 16:20:32.899628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 465/934] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:20:33.104137 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ecc5a925-807e-4655-92ac-e2ab60d6b789 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:33.105031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ecc5a925-807e-4655-92ac-e2ab60d6b789 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:33.121654 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ecc5a925-807e-4655-92ac-e2ab60d6b789 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:33.122166 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ecc5a925-807e-4655-92ac-e2ab60d6b789 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:33.122621 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ecc5a925-807e-4655-92ac-e2ab60d6b789 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:33.123953 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ecc5a925-807e-4655-92ac-e2ab60d6b789 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:33.131924 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ecc5a925-807e-4655-92ac-e2ab60d6b789 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:33.132762 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ecc5a925-807e-4655-92ac-e2ab60d6b789 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:33.220386 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4e18135c-8cc5-4c80-a4ef-a1d46c5b96cb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:33.260106 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4e18135c-8cc5-4c80-a4ef-a1d46c5b96cb tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1576 microversion: 2.1 time: 0.468077 Sep 04 16:20:33.277807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 470/935] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:32 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1576 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:33.595500 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ea0654c7-2daf-471a-a20a-f5bf1d619bd6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:33.596102 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ea0654c7-2daf-471a-a20a-f5bf1d619bd6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:33.602524 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea0654c7-2daf-471a-a20a-f5bf1d619bd6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:33.603001 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea0654c7-2daf-471a-a20a-f5bf1d619bd6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:33.603427 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea0654c7-2daf-471a-a20a-f5bf1d619bd6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:33.604130 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea0654c7-2daf-471a-a20a-f5bf1d619bd6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:33.604573 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea0654c7-2daf-471a-a20a-f5bf1d619bd6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:33.604980 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ea0654c7-2daf-471a-a20a-f5bf1d619bd6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:33.924571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ecc5a925-807e-4655-92ac-e2ab60d6b789 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:33.945312 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ecc5a925-807e-4655-92ac-e2ab60d6b789 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:33.951602 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ecc5a925-807e-4655-92ac-e2ab60d6b789 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:33.958430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ecc5a925-807e-4655-92ac-e2ab60d6b789 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1740 microversion: 2.20 time: 0.857650 Sep 04 16:20:33.960678 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 466/936] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:33 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1740 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:33.979693 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-77d2d8ef-c548-4d93-9aa6-b5cc6e0a4448 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:33.981068 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-77d2d8ef-c548-4d93-9aa6-b5cc6e0a4448 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:33.993937 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-77d2d8ef-c548-4d93-9aa6-b5cc6e0a4448 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:33.997619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-77d2d8ef-c548-4d93-9aa6-b5cc6e0a4448 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:33.999061 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-77d2d8ef-c548-4d93-9aa6-b5cc6e0a4448 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:34.005621 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-77d2d8ef-c548-4d93-9aa6-b5cc6e0a4448 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:34.006390 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-77d2d8ef-c548-4d93-9aa6-b5cc6e0a4448 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:34.007006 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-77d2d8ef-c548-4d93-9aa6-b5cc6e0a4448 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:34.075866 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=100 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:20:34.250104 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ea0654c7-2daf-471a-a20a-f5bf1d619bd6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:34.268642 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ea0654c7-2daf-471a-a20a-f5bf1d619bd6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4" status: 200 len: 1366 microversion: 2.1 time: 0.676301 Sep 04 16:20:34.273555 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 471/937] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:33 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 => generated 1366 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:34.288116 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c5b8a697-0948-465a-9e0a-9a215e572175 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:34.293090 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c5b8a697-0948-465a-9e0a-9a215e572175 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:34.318190 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5b8a697-0948-465a-9e0a-9a215e572175 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:34.318700 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5b8a697-0948-465a-9e0a-9a215e572175 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:34.319143 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5b8a697-0948-465a-9e0a-9a215e572175 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:34.325008 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5b8a697-0948-465a-9e0a-9a215e572175 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:34.332755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5b8a697-0948-465a-9e0a-9a215e572175 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:34.332755 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c5b8a697-0948-465a-9e0a-9a215e572175 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:34.461429 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-77d2d8ef-c548-4d93-9aa6-b5cc6e0a4448 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:34.474305 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-77d2d8ef-c548-4d93-9aa6-b5cc6e0a4448 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1266 microversion: 2.1 time: 0.510074 Sep 04 16:20:34.491547 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 467/938] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:33 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1266 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:34.703007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c5b8a697-0948-465a-9e0a-9a215e572175 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:34.712277 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c5b8a697-0948-465a-9e0a-9a215e572175 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1576 microversion: 2.1 time: 0.429362 Sep 04 16:20:34.712854 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 472/939] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:34 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1576 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:34.925799 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-e30f6932-d16f-46d2-a2f5-62fec9217a76 req-867553a9-05ff-49d0-a420-f0e3d14e14fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84acd9f2-8732-4d8b-843e-46e2ccd5e5cc", "name": "network-vif-plugged", "status": "completed", "tag": "b7aa303d-deea-4135-89b8-303faf88bdfe"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:20:34.937550 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-e30f6932-d16f-46d2-a2f5-62fec9217a76 req-867553a9-05ff-49d0-a420-f0e3d14e14fc service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:34.940252 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-e30f6932-d16f-46d2-a2f5-62fec9217a76 req-867553a9-05ff-49d0-a420-f0e3d14e14fc service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:34.940252 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-e30f6932-d16f-46d2-a2f5-62fec9217a76 req-867553a9-05ff-49d0-a420-f0e3d14e14fc service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:34.952785 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-e30f6932-d16f-46d2-a2f5-62fec9217a76 req-867553a9-05ff-49d0-a420-f0e3d14e14fc service nova] Creating event network-vif-plugged:b7aa303d-deea-4135-89b8-303faf88bdfe for instance 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc on hv-cinder-85236 Sep 04 16:20:34.959293 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-e30f6932-d16f-46d2-a2f5-62fec9217a76 req-867553a9-05ff-49d0-a420-f0e3d14e14fc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039847 Sep 04 16:20:34.963816 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 468/940] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:20:34.987409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e704ccba-9bca-451c-8f5d-c8d22f29a3d8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:34.988643 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e704ccba-9bca-451c-8f5d-c8d22f29a3d8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:34.995274 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e704ccba-9bca-451c-8f5d-c8d22f29a3d8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:34.996002 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e704ccba-9bca-451c-8f5d-c8d22f29a3d8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:34.996511 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e704ccba-9bca-451c-8f5d-c8d22f29a3d8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:34.997275 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e704ccba-9bca-451c-8f5d-c8d22f29a3d8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:34.997960 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e704ccba-9bca-451c-8f5d-c8d22f29a3d8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:34.998519 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e704ccba-9bca-451c-8f5d-c8d22f29a3d8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:35.265733 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e704ccba-9bca-451c-8f5d-c8d22f29a3d8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:35.274718 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e704ccba-9bca-451c-8f5d-c8d22f29a3d8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:35.276147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e704ccba-9bca-451c-8f5d-c8d22f29a3d8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:35.284023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e704ccba-9bca-451c-8f5d-c8d22f29a3d8 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1740 microversion: 2.20 time: 0.302374 Sep 04 16:20:35.284611 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 473/941] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:34 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1740 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:20:35.304747 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-22371ca3-0c0f-432d-b582-e5d12ac50ed7 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:35.305815 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-22371ca3-0c0f-432d-b582-e5d12ac50ed7 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:35.313893 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-22371ca3-0c0f-432d-b582-e5d12ac50ed7 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:35.314641 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-22371ca3-0c0f-432d-b582-e5d12ac50ed7 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:35.315250 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-22371ca3-0c0f-432d-b582-e5d12ac50ed7 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:35.316150 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-22371ca3-0c0f-432d-b582-e5d12ac50ed7 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:35.316880 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-22371ca3-0c0f-432d-b582-e5d12ac50ed7 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:35.317468 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-22371ca3-0c0f-432d-b582-e5d12ac50ed7 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:35.499186 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2c45235b-4101-437c-be66-7758a90e76d1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:35.501732 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2c45235b-4101-437c-be66-7758a90e76d1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:35.523739 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c45235b-4101-437c-be66-7758a90e76d1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:35.524884 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c45235b-4101-437c-be66-7758a90e76d1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:35.525502 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c45235b-4101-437c-be66-7758a90e76d1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:35.526567 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c45235b-4101-437c-be66-7758a90e76d1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:35.527241 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c45235b-4101-437c-be66-7758a90e76d1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:35.527810 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2c45235b-4101-437c-be66-7758a90e76d1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:35.536316 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=100 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:20:35.684907 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-22371ca3-0c0f-432d-b582-e5d12ac50ed7 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:35.695221 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-22371ca3-0c0f-432d-b582-e5d12ac50ed7 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4" status: 200 len: 1366 microversion: 2.1 time: 0.394822 Sep 04 16:20:35.696664 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 469/942] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:35 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 => generated 1366 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:35.702427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-2927f416-4ebe-4697-8365-0e309fa5e540 req-f309ccad-b2e9-4b48-b49c-71effaae0130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca19c96e-1c3a-4bb3-875a-a16eb18f59b4", "tag": "9501fe5b-4b6e-4acf-abe4-45f64425a768"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:20:35.716238 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-2927f416-4ebe-4697-8365-0e309fa5e540 req-f309ccad-b2e9-4b48-b49c-71effaae0130 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:35.716935 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-2927f416-4ebe-4697-8365-0e309fa5e540 req-f309ccad-b2e9-4b48-b49c-71effaae0130 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:35.717839 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-2927f416-4ebe-4697-8365-0e309fa5e540 req-f309ccad-b2e9-4b48-b49c-71effaae0130 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:35.730954 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-2927f416-4ebe-4697-8365-0e309fa5e540 req-f309ccad-b2e9-4b48-b49c-71effaae0130 service nova] Creating event network-changed:9501fe5b-4b6e-4acf-abe4-45f64425a768 for instance ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 on hv-cinder-85236 Sep 04 16:20:35.737216 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-2927f416-4ebe-4697-8365-0e309fa5e540 req-f309ccad-b2e9-4b48-b49c-71effaae0130 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038881 Sep 04 16:20:35.745903 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 470/943] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:20:35.753019 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5dcd6814-78e9-4c5a-8f1f-5410f5d67161 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:35.754010 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5dcd6814-78e9-4c5a-8f1f-5410f5d67161 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:35.768786 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5dcd6814-78e9-4c5a-8f1f-5410f5d67161 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:35.770844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5dcd6814-78e9-4c5a-8f1f-5410f5d67161 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:35.771608 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5dcd6814-78e9-4c5a-8f1f-5410f5d67161 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:35.772782 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5dcd6814-78e9-4c5a-8f1f-5410f5d67161 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:35.773404 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5dcd6814-78e9-4c5a-8f1f-5410f5d67161 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:35.774036 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5dcd6814-78e9-4c5a-8f1f-5410f5d67161 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:35.784503 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2c45235b-4101-437c-be66-7758a90e76d1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:35.795659 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2c45235b-4101-437c-be66-7758a90e76d1 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1266 microversion: 2.1 time: 0.301116 Sep 04 16:20:35.806446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 474/944] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:35 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1266 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:36.086250 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5dcd6814-78e9-4c5a-8f1f-5410f5d67161 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:36.110998 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5dcd6814-78e9-4c5a-8f1f-5410f5d67161 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1576 microversion: 2.1 time: 0.349780 Sep 04 16:20:36.125689 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 471/945] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:35 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1576 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:36.321232 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-630fc239-977f-426a-9d75-a3d5916a3b8a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:36.322117 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-630fc239-977f-426a-9d75-a3d5916a3b8a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:36.339808 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-630fc239-977f-426a-9d75-a3d5916a3b8a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:36.340450 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-630fc239-977f-426a-9d75-a3d5916a3b8a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:36.341316 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-630fc239-977f-426a-9d75-a3d5916a3b8a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:36.343750 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-630fc239-977f-426a-9d75-a3d5916a3b8a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:36.344430 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-630fc239-977f-426a-9d75-a3d5916a3b8a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:36.345314 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-630fc239-977f-426a-9d75-a3d5916a3b8a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:36.558073 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-630fc239-977f-426a-9d75-a3d5916a3b8a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:36.574890 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-630fc239-977f-426a-9d75-a3d5916a3b8a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:36.576350 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-630fc239-977f-426a-9d75-a3d5916a3b8a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:36.578902 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-630fc239-977f-426a-9d75-a3d5916a3b8a tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1740 microversion: 2.20 time: 0.269255 Sep 04 16:20:36.585167 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 475/946] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:36 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1740 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:36.720758 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-26890003-aab8-4f98-b92b-24193654b5da tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:36.721587 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-26890003-aab8-4f98-b92b-24193654b5da tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:36.728480 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26890003-aab8-4f98-b92b-24193654b5da tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:36.729173 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26890003-aab8-4f98-b92b-24193654b5da tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:36.730039 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26890003-aab8-4f98-b92b-24193654b5da tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:36.731449 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26890003-aab8-4f98-b92b-24193654b5da tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:36.732254 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26890003-aab8-4f98-b92b-24193654b5da tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:36.733607 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26890003-aab8-4f98-b92b-24193654b5da tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:36.819381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ee3624c9-58d2-444e-adfd-05169b336767 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:36.820244 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ee3624c9-58d2-444e-adfd-05169b336767 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:36.831457 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee3624c9-58d2-444e-adfd-05169b336767 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:36.832232 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee3624c9-58d2-444e-adfd-05169b336767 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:36.832844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee3624c9-58d2-444e-adfd-05169b336767 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:36.833767 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee3624c9-58d2-444e-adfd-05169b336767 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:36.834221 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee3624c9-58d2-444e-adfd-05169b336767 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:36.834639 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ee3624c9-58d2-444e-adfd-05169b336767 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:37.031735 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-26890003-aab8-4f98-b92b-24193654b5da tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:37.072522 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ee3624c9-58d2-444e-adfd-05169b336767 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:37.074585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-26890003-aab8-4f98-b92b-24193654b5da tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4" status: 200 len: 1366 microversion: 2.1 time: 0.358760 Sep 04 16:20:37.093325 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 472/947] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:36 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 => generated 1366 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:37.101743 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ee3624c9-58d2-444e-adfd-05169b336767 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1452 microversion: 2.1 time: 0.286103 Sep 04 16:20:37.117868 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 476/948] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:36 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1452 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:37.132838 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-df39f345-c56c-4fe6-81e7-0be50fe33ead tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:37.134923 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-df39f345-c56c-4fe6-81e7-0be50fe33ead tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:37.144318 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-55381ff3-135a-4b8a-b857-5f5e06905b83 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:37.153076 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-df39f345-c56c-4fe6-81e7-0be50fe33ead tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:37.154255 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-55381ff3-135a-4b8a-b857-5f5e06905b83 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:37.155132 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-df39f345-c56c-4fe6-81e7-0be50fe33ead tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:37.158162 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-df39f345-c56c-4fe6-81e7-0be50fe33ead tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:37.159169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-df39f345-c56c-4fe6-81e7-0be50fe33ead tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:37.159924 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-df39f345-c56c-4fe6-81e7-0be50fe33ead tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:37.160588 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-df39f345-c56c-4fe6-81e7-0be50fe33ead tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:37.179385 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55381ff3-135a-4b8a-b857-5f5e06905b83 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:37.180333 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55381ff3-135a-4b8a-b857-5f5e06905b83 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:37.180992 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55381ff3-135a-4b8a-b857-5f5e06905b83 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:37.182020 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55381ff3-135a-4b8a-b857-5f5e06905b83 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:37.183268 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55381ff3-135a-4b8a-b857-5f5e06905b83 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:37.190286 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-55381ff3-135a-4b8a-b857-5f5e06905b83 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:37.798899 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-df39f345-c56c-4fe6-81e7-0be50fe33ead tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:37.806623 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-df39f345-c56c-4fe6-81e7-0be50fe33ead tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1452 microversion: 2.1 time: 0.681014 Sep 04 16:20:37.807192 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 473/949] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:37 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1452 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:37.814514 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c11c325c-fcf8-4eb3-9bc9-7f3025b51546 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:37.814514 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c11c325c-fcf8-4eb3-9bc9-7f3025b51546 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:37.818707 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-55381ff3-135a-4b8a-b857-5f5e06905b83 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:37.819588 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c11c325c-fcf8-4eb3-9bc9-7f3025b51546 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:37.820185 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c11c325c-fcf8-4eb3-9bc9-7f3025b51546 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:37.820726 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c11c325c-fcf8-4eb3-9bc9-7f3025b51546 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:37.821704 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c11c325c-fcf8-4eb3-9bc9-7f3025b51546 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:37.822277 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c11c325c-fcf8-4eb3-9bc9-7f3025b51546 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:37.823541 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c11c325c-fcf8-4eb3-9bc9-7f3025b51546 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:37.830604 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-55381ff3-135a-4b8a-b857-5f5e06905b83 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1576 microversion: 2.1 time: 0.689461 Sep 04 16:20:37.841991 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 477/950] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:37 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1576 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:38.068618 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c11c325c-fcf8-4eb3-9bc9-7f3025b51546 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:38.081759 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c11c325c-fcf8-4eb3-9bc9-7f3025b51546 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:38.083406 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-c11c325c-fcf8-4eb3-9bc9-7f3025b51546 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:38.084619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c11c325c-fcf8-4eb3-9bc9-7f3025b51546 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1740 microversion: 2.20 time: 0.276500 Sep 04 16:20:38.085191 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 474/951] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:37 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1740 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:38.103833 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-643b6799-b266-4a1e-83ac-da9f71fe9ef0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:38.104447 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-643b6799-b266-4a1e-83ac-da9f71fe9ef0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:38.116170 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-643b6799-b266-4a1e-83ac-da9f71fe9ef0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:38.116678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-643b6799-b266-4a1e-83ac-da9f71fe9ef0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:38.119313 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-643b6799-b266-4a1e-83ac-da9f71fe9ef0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:38.120304 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-643b6799-b266-4a1e-83ac-da9f71fe9ef0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:38.120995 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-643b6799-b266-4a1e-83ac-da9f71fe9ef0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:38.121605 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-643b6799-b266-4a1e-83ac-da9f71fe9ef0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:38.315176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-643b6799-b266-4a1e-83ac-da9f71fe9ef0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:38.340210 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-643b6799-b266-4a1e-83ac-da9f71fe9ef0 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4" status: 200 len: 1366 microversion: 2.1 time: 0.242540 Sep 04 16:20:38.340792 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 478/952] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:38 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:38.855087 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f3d65f0a-e9fe-48ab-aeee-4deaeb737101 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:38.855696 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f3d65f0a-e9fe-48ab-aeee-4deaeb737101 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:38.862806 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:20:38.863839 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=6 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:20:38.866298 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f3d65f0a-e9fe-48ab-aeee-4deaeb737101 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:38.867045 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f3d65f0a-e9fe-48ab-aeee-4deaeb737101 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:38.867715 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f3d65f0a-e9fe-48ab-aeee-4deaeb737101 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:38.868642 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f3d65f0a-e9fe-48ab-aeee-4deaeb737101 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:38.869350 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f3d65f0a-e9fe-48ab-aeee-4deaeb737101 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:38.870191 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f3d65f0a-e9fe-48ab-aeee-4deaeb737101 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:39.040175 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f3d65f0a-e9fe-48ab-aeee-4deaeb737101 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:39.048762 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f3d65f0a-e9fe-48ab-aeee-4deaeb737101 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1563 microversion: 2.1 time: 0.197380 Sep 04 16:20:39.049513 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 475/953] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:38 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1563 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:39.113368 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-674adfec-642e-4371-a0f0-2ad7cdc55893 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:39.113995 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-674adfec-642e-4371-a0f0-2ad7cdc55893 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:39.120533 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-674adfec-642e-4371-a0f0-2ad7cdc55893 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:39.121012 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-674adfec-642e-4371-a0f0-2ad7cdc55893 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:39.121441 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-674adfec-642e-4371-a0f0-2ad7cdc55893 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:39.122159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-674adfec-642e-4371-a0f0-2ad7cdc55893 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:39.122612 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-674adfec-642e-4371-a0f0-2ad7cdc55893 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:39.123034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-674adfec-642e-4371-a0f0-2ad7cdc55893 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:39.256987 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-674adfec-642e-4371-a0f0-2ad7cdc55893 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:39.266582 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-674adfec-642e-4371-a0f0-2ad7cdc55893 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:39.268230 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-674adfec-642e-4371-a0f0-2ad7cdc55893 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:39.269422 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-674adfec-642e-4371-a0f0-2ad7cdc55893 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1740 microversion: 2.20 time: 0.160153 Sep 04 16:20:39.269995 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 479/954] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:39 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:39.368302 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b9b13150-68bb-47d3-bf30-0c9f98e43acb tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:39.369283 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b9b13150-68bb-47d3-bf30-0c9f98e43acb tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:39.375579 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b9b13150-68bb-47d3-bf30-0c9f98e43acb tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:39.376073 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b9b13150-68bb-47d3-bf30-0c9f98e43acb tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:39.376517 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b9b13150-68bb-47d3-bf30-0c9f98e43acb tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:39.377219 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b9b13150-68bb-47d3-bf30-0c9f98e43acb tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:39.377701 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b9b13150-68bb-47d3-bf30-0c9f98e43acb tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:39.378132 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b9b13150-68bb-47d3-bf30-0c9f98e43acb tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:39.521854 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b9b13150-68bb-47d3-bf30-0c9f98e43acb tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:39.530488 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b9b13150-68bb-47d3-bf30-0c9f98e43acb tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4" status: 200 len: 1366 microversion: 2.1 time: 0.165294 Sep 04 16:20:39.530988 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 476/955] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:39 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:40.294866 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-571aef8f-4ffc-4cb9-82c3-98333488615c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:40.295426 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-571aef8f-4ffc-4cb9-82c3-98333488615c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:40.298423 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=8 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:20:40.304173 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-571aef8f-4ffc-4cb9-82c3-98333488615c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:40.304667 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-571aef8f-4ffc-4cb9-82c3-98333488615c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:40.305094 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-571aef8f-4ffc-4cb9-82c3-98333488615c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:40.305925 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-571aef8f-4ffc-4cb9-82c3-98333488615c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:40.306375 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-571aef8f-4ffc-4cb9-82c3-98333488615c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:40.306795 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-571aef8f-4ffc-4cb9-82c3-98333488615c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:40.533841 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-53a6d28e-61a2-454f-9458-91b0ead56b6d req-fd42f087-cdd2-432b-a251-78d5c5b1e627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c65f38-de9c-4de3-8cf5-92147eb37728", "tag": "329a6f01-f405-46c1-8565-cde5c89b347e"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:20:40.544688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-53a6d28e-61a2-454f-9458-91b0ead56b6d req-fd42f087-cdd2-432b-a251-78d5c5b1e627 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:40.657921 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-53a6d28e-61a2-454f-9458-91b0ead56b6d req-fd42f087-cdd2-432b-a251-78d5c5b1e627 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:40.657921 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-53a6d28e-61a2-454f-9458-91b0ead56b6d req-fd42f087-cdd2-432b-a251-78d5c5b1e627 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:40.658932 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-571aef8f-4ffc-4cb9-82c3-98333488615c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:40.659058 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-53a6d28e-61a2-454f-9458-91b0ead56b6d req-fd42f087-cdd2-432b-a251-78d5c5b1e627 service nova] Creating event network-changed:329a6f01-f405-46c1-8565-cde5c89b347e for instance 04c65f38-de9c-4de3-8cf5-92147eb37728 on hv-cinder-85236 Sep 04 16:20:40.659058 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-53a6d28e-61a2-454f-9458-91b0ead56b6d req-fd42f087-cdd2-432b-a251-78d5c5b1e627 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035365 Sep 04 16:20:40.659058 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 477/956] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:20:40.659327 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-571aef8f-4ffc-4cb9-82c3-98333488615c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:40.659327 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-571aef8f-4ffc-4cb9-82c3-98333488615c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:40.659607 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8c6b6bcf-b102-49d3-afe0-f551c5c95fa4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:40.659607 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8c6b6bcf-b102-49d3-afe0-f551c5c95fa4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:40.659792 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-571aef8f-4ffc-4cb9-82c3-98333488615c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1722 microversion: 2.20 time: 0.285220 Sep 04 16:20:40.659888 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8c6b6bcf-b102-49d3-afe0-f551c5c95fa4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:40.659888 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8c6b6bcf-b102-49d3-afe0-f551c5c95fa4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:40.659888 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8c6b6bcf-b102-49d3-afe0-f551c5c95fa4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:40.659888 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8c6b6bcf-b102-49d3-afe0-f551c5c95fa4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:40.660226 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8c6b6bcf-b102-49d3-afe0-f551c5c95fa4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:40.660226 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8c6b6bcf-b102-49d3-afe0-f551c5c95fa4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:40.660398 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 480/957] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:40 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1722 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:40.935235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-8c6b6bcf-b102-49d3-afe0-f551c5c95fa4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:40.947325 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8c6b6bcf-b102-49d3-afe0-f551c5c95fa4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4" status: 200 len: 1366 microversion: 2.1 time: 0.377311 Sep 04 16:20:40.961590 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 478/958] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:40 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:41.607830 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d55ecced-1de7-4a0f-8a96-73e029e9f490 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:41.608970 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d55ecced-1de7-4a0f-8a96-73e029e9f490 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:41.615553 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d55ecced-1de7-4a0f-8a96-73e029e9f490 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:41.618355 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d55ecced-1de7-4a0f-8a96-73e029e9f490 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:41.618355 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d55ecced-1de7-4a0f-8a96-73e029e9f490 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:41.618355 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d55ecced-1de7-4a0f-8a96-73e029e9f490 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:41.618355 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d55ecced-1de7-4a0f-8a96-73e029e9f490 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:41.618714 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d55ecced-1de7-4a0f-8a96-73e029e9f490 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:41.759517 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d55ecced-1de7-4a0f-8a96-73e029e9f490 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:41.768299 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d55ecced-1de7-4a0f-8a96-73e029e9f490 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:41.769885 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d55ecced-1de7-4a0f-8a96-73e029e9f490 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:41.771073 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d55ecced-1de7-4a0f-8a96-73e029e9f490 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1722 microversion: 2.20 time: 0.167297 Sep 04 16:20:41.771613 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 481/959] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:41 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:41.972625 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9535b6b6-1599-4419-8354-424bb1b0de8c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:41.973192 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9535b6b6-1599-4419-8354-424bb1b0de8c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:41.979521 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9535b6b6-1599-4419-8354-424bb1b0de8c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:41.980000 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9535b6b6-1599-4419-8354-424bb1b0de8c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:41.980431 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9535b6b6-1599-4419-8354-424bb1b0de8c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:41.981114 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9535b6b6-1599-4419-8354-424bb1b0de8c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:41.981584 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9535b6b6-1599-4419-8354-424bb1b0de8c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:41.982001 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9535b6b6-1599-4419-8354-424bb1b0de8c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:42.113221 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9535b6b6-1599-4419-8354-424bb1b0de8c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:42.121146 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9535b6b6-1599-4419-8354-424bb1b0de8c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4" status: 200 len: 1366 microversion: 2.1 time: 0.152467 Sep 04 16:20:42.121739 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 479/960] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:41 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:42.797713 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-6ca31fc6-2025-412f-9797-e0a2a372b6d7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:42.798315 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-6ca31fc6-2025-412f-9797-e0a2a372b6d7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:42.804908 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ca31fc6-2025-412f-9797-e0a2a372b6d7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:42.805378 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ca31fc6-2025-412f-9797-e0a2a372b6d7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:42.805836 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ca31fc6-2025-412f-9797-e0a2a372b6d7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:42.806525 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ca31fc6-2025-412f-9797-e0a2a372b6d7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:42.806969 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ca31fc6-2025-412f-9797-e0a2a372b6d7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:42.807386 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-6ca31fc6-2025-412f-9797-e0a2a372b6d7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:42.998992 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-6ca31fc6-2025-412f-9797-e0a2a372b6d7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:43.007793 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-6ca31fc6-2025-412f-9797-e0a2a372b6d7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:43.009475 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-6ca31fc6-2025-412f-9797-e0a2a372b6d7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:43.010633 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-6ca31fc6-2025-412f-9797-e0a2a372b6d7 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1722 microversion: 2.20 time: 0.217139 Sep 04 16:20:43.011418 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 482/961] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:42 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:43.145707 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a48fcbcb-0066-4fe9-a681-7acf426ccfc3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:43.146376 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a48fcbcb-0066-4fe9-a681-7acf426ccfc3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:43.159648 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a48fcbcb-0066-4fe9-a681-7acf426ccfc3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:43.160135 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a48fcbcb-0066-4fe9-a681-7acf426ccfc3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:43.163185 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a48fcbcb-0066-4fe9-a681-7acf426ccfc3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:43.163185 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a48fcbcb-0066-4fe9-a681-7acf426ccfc3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:43.163185 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a48fcbcb-0066-4fe9-a681-7acf426ccfc3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:43.163185 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a48fcbcb-0066-4fe9-a681-7acf426ccfc3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:43.301322 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a48fcbcb-0066-4fe9-a681-7acf426ccfc3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:43.308984 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a48fcbcb-0066-4fe9-a681-7acf426ccfc3 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4" status: 200 len: 1366 microversion: 2.1 time: 0.167180 Sep 04 16:20:43.309551 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 480/962] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:43 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:44.036905 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bb0d78a4-9888-47f9-a262-dfd1538686f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:44.037503 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bb0d78a4-9888-47f9-a262-dfd1538686f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:44.044112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb0d78a4-9888-47f9-a262-dfd1538686f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:44.044590 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb0d78a4-9888-47f9-a262-dfd1538686f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:44.045023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb0d78a4-9888-47f9-a262-dfd1538686f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:44.045750 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb0d78a4-9888-47f9-a262-dfd1538686f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:44.046811 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb0d78a4-9888-47f9-a262-dfd1538686f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:44.047242 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bb0d78a4-9888-47f9-a262-dfd1538686f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:44.180407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-bb0d78a4-9888-47f9-a262-dfd1538686f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:44.189354 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-bb0d78a4-9888-47f9-a262-dfd1538686f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:44.190843 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-bb0d78a4-9888-47f9-a262-dfd1538686f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:44.192092 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bb0d78a4-9888-47f9-a262-dfd1538686f2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1665 microversion: 2.20 time: 0.159189 Sep 04 16:20:44.192647 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 483/963] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:44 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1665 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:44.216941 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-bce575b1-dc50-4442-b7f8-74b8520b994d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f893d28e-d9be-47db-809b-478282d61af1"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:20:44.221689 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-bce575b1-dc50-4442-b7f8-74b8520b994d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:44.229339 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bce575b1-dc50-4442-b7f8-74b8520b994d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:44.230286 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bce575b1-dc50-4442-b7f8-74b8520b994d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:44.230726 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bce575b1-dc50-4442-b7f8-74b8520b994d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:44.231432 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bce575b1-dc50-4442-b7f8-74b8520b994d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:44.232101 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bce575b1-dc50-4442-b7f8-74b8520b994d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:44.232527 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bce575b1-dc50-4442-b7f8-74b8520b994d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:44.339119 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-04d3e586-7cb7-46c7-abe5-6e6eb047478c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:44.339898 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-04d3e586-7cb7-46c7-abe5-6e6eb047478c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:44.346571 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04d3e586-7cb7-46c7-abe5-6e6eb047478c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:44.346947 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04d3e586-7cb7-46c7-abe5-6e6eb047478c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:44.351792 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04d3e586-7cb7-46c7-abe5-6e6eb047478c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:44.351792 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04d3e586-7cb7-46c7-abe5-6e6eb047478c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:44.351792 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04d3e586-7cb7-46c7-abe5-6e6eb047478c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:44.351792 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-04d3e586-7cb7-46c7-abe5-6e6eb047478c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:44.493540 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-04d3e586-7cb7-46c7-abe5-6e6eb047478c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:44.502158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-04d3e586-7cb7-46c7-abe5-6e6eb047478c tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4" status: 200 len: 1366 microversion: 2.1 time: 0.167688 Sep 04 16:20:44.502728 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 484/964] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:44 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:44.507104 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-8e4d9e9f-ab20-42b1-9f49-b685e47ab69c req-90dbf4fb-9e4e-4f3e-a689-b0fb99652e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca19c96e-1c3a-4bb3-875a-a16eb18f59b4", "name": "network-vif-plugged", "status": "completed", "tag": "9501fe5b-4b6e-4acf-abe4-45f64425a768"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:20:44.516849 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8e4d9e9f-ab20-42b1-9f49-b685e47ab69c req-90dbf4fb-9e4e-4f3e-a689-b0fb99652e01 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:44.517318 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8e4d9e9f-ab20-42b1-9f49-b685e47ab69c req-90dbf4fb-9e4e-4f3e-a689-b0fb99652e01 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:44.517783 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-8e4d9e9f-ab20-42b1-9f49-b685e47ab69c req-90dbf4fb-9e4e-4f3e-a689-b0fb99652e01 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:44.530652 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-8e4d9e9f-ab20-42b1-9f49-b685e47ab69c req-90dbf4fb-9e4e-4f3e-a689-b0fb99652e01 service nova] Creating event network-vif-plugged:9501fe5b-4b6e-4acf-abe4-45f64425a768 for instance ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 on hv-cinder-85236 Sep 04 16:20:44.535577 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-8e4d9e9f-ab20-42b1-9f49-b685e47ab69c req-90dbf4fb-9e4e-4f3e-a689-b0fb99652e01 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031719 Sep 04 16:20:44.536137 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 485/965] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:20:45.350714 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-bce575b1-dc50-4442-b7f8-74b8520b994d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "POST /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.137544 Sep 04 16:20:45.351357 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 481/966] 10.222.0.39 () {62 vars in 1364 bytes} [Sun Sep 4 16:20:44 2022] POST /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73/os-volume_attachments => generated 188 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 04 16:20:45.482806 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-03fc2a7f-e2d2-4bfc-ba13-fe16b055bf0d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:45.483388 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-03fc2a7f-e2d2-4bfc-ba13-fe16b055bf0d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:45.489619 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03fc2a7f-e2d2-4bfc-ba13-fe16b055bf0d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:45.490099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03fc2a7f-e2d2-4bfc-ba13-fe16b055bf0d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:45.490530 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03fc2a7f-e2d2-4bfc-ba13-fe16b055bf0d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:45.491212 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03fc2a7f-e2d2-4bfc-ba13-fe16b055bf0d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:45.491661 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03fc2a7f-e2d2-4bfc-ba13-fe16b055bf0d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:45.492078 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03fc2a7f-e2d2-4bfc-ba13-fe16b055bf0d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:45.525952 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-13bee50f-bbcc-4989-8bae-d89f81633268 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:45.526563 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-13bee50f-bbcc-4989-8bae-d89f81633268 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:45.533184 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-13bee50f-bbcc-4989-8bae-d89f81633268 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:45.533748 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-13bee50f-bbcc-4989-8bae-d89f81633268 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:45.534179 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-13bee50f-bbcc-4989-8bae-d89f81633268 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:45.534864 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-13bee50f-bbcc-4989-8bae-d89f81633268 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:45.535309 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-13bee50f-bbcc-4989-8bae-d89f81633268 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:45.535725 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-13bee50f-bbcc-4989-8bae-d89f81633268 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:45.667213 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-13bee50f-bbcc-4989-8bae-d89f81633268 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:45.675029 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-13bee50f-bbcc-4989-8bae-d89f81633268 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4" status: 200 len: 1366 microversion: 2.1 time: 0.153154 Sep 04 16:20:45.675533 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 482/967] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:45 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:20:46.090579 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-03fc2a7f-e2d2-4bfc-ba13-fe16b055bf0d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73/os-volume_attachments/f893d28e-d9be-47db-809b-478282d61af1" status: 202 len: 0 microversion: 2.20 time: 0.612649 Sep 04 16:20:46.091195 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 486/968] 10.222.0.39 () {60 vars in 1457 bytes} [Sun Sep 4 16:20:45 2022] DELETE /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73/os-volume_attachments/f893d28e-d9be-47db-809b-478282d61af1 => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 04 16:20:46.157510 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ee811b44-cd45-431d-bfcb-bc23d914ad38 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:20:46.158256 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ee811b44-cd45-431d-bfcb-bc23d914ad38 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:46.169385 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ee811b44-cd45-431d-bfcb-bc23d914ad38 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:46.169385 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ee811b44-cd45-431d-bfcb-bc23d914ad38 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:46.169385 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ee811b44-cd45-431d-bfcb-bc23d914ad38 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:46.169385 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ee811b44-cd45-431d-bfcb-bc23d914ad38 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:46.169772 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ee811b44-cd45-431d-bfcb-bc23d914ad38 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:46.169772 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ee811b44-cd45-431d-bfcb-bc23d914ad38 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:46.186057 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:20:46.198712 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ee811b44-cd45-431d-bfcb-bc23d914ad38 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121041) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 04 16:20:46.495885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ee811b44-cd45-431d-bfcb-bc23d914ad38 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "POST /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73/action" status: 202 len: 0 microversion: 2.20 time: 0.342597 Sep 04 16:20:46.496764 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 483/969] 10.222.0.39 () {62 vars in 1319 bytes} [Sun Sep 4 16:20:46 2022] POST /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 04 16:20:46.508490 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1c579964-0272-4f65-988e-ac5449525400 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:46.508490 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1c579964-0272-4f65-988e-ac5449525400 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:46.515011 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c579964-0272-4f65-988e-ac5449525400 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:46.515439 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c579964-0272-4f65-988e-ac5449525400 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:46.516193 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c579964-0272-4f65-988e-ac5449525400 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:46.517000 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c579964-0272-4f65-988e-ac5449525400 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:46.517607 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c579964-0272-4f65-988e-ac5449525400 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:46.518138 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1c579964-0272-4f65-988e-ac5449525400 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:46.550495 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-611a12c7-90ee-4508-9725-d2a5f4cc1dd2 req-37945253-adc6-40fd-8133-6850a237391b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73", "name": "network-vif-unplugged", "status": "completed", "tag": "6d210ca9-1ff4-4f3e-842e-652e252e69a7"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:20:46.560016 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-611a12c7-90ee-4508-9725-d2a5f4cc1dd2 req-37945253-adc6-40fd-8133-6850a237391b service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:46.560495 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-611a12c7-90ee-4508-9725-d2a5f4cc1dd2 req-37945253-adc6-40fd-8133-6850a237391b service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:46.560914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-611a12c7-90ee-4508-9725-d2a5f4cc1dd2 req-37945253-adc6-40fd-8133-6850a237391b service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:46.573907 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.compute.server_external_events [req-611a12c7-90ee-4508-9725-d2a5f4cc1dd2 req-37945253-adc6-40fd-8133-6850a237391b service nova] Unable to find a host for instance ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73. Dropping event network-vif-unplugged {{(pid=121041) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 04 16:20:46.574788 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-611a12c7-90ee-4508-9725-d2a5f4cc1dd2 req-37945253-adc6-40fd-8133-6850a237391b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029220 Sep 04 16:20:46.575374 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 484/970] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 04 16:20:46.661730 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1c579964-0272-4f65-988e-ac5449525400 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:46.669933 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1c579964-0272-4f65-988e-ac5449525400 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:46.672377 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1c579964-0272-4f65-988e-ac5449525400 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:46.673155 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1c579964-0272-4f65-988e-ac5449525400 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1673 microversion: 2.20 time: 0.172808 Sep 04 16:20:46.673733 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 487/971] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:46 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:20:46.698695 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-db24ef33-0f99-4d57-8cc3-90acf5cc1902 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:46.699298 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-db24ef33-0f99-4d57-8cc3-90acf5cc1902 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:46.705467 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-db24ef33-0f99-4d57-8cc3-90acf5cc1902 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:46.705979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-db24ef33-0f99-4d57-8cc3-90acf5cc1902 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:46.706408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-db24ef33-0f99-4d57-8cc3-90acf5cc1902 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:46.707097 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-db24ef33-0f99-4d57-8cc3-90acf5cc1902 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:46.707544 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-db24ef33-0f99-4d57-8cc3-90acf5cc1902 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:46.707965 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-db24ef33-0f99-4d57-8cc3-90acf5cc1902 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:46.846932 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-db24ef33-0f99-4d57-8cc3-90acf5cc1902 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:46.856960 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-db24ef33-0f99-4d57-8cc3-90acf5cc1902 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4" status: 200 len: 1556 microversion: 2.1 time: 0.161959 Sep 04 16:20:46.861510 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 485/972] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:20:46 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:20:46.882281 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-71df6005-4bc6-4e5d-826d-22a666611b18 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:46.882905 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-71df6005-4bc6-4e5d-826d-22a666611b18 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:46.895544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71df6005-4bc6-4e5d-826d-22a666611b18 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:46.895544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71df6005-4bc6-4e5d-826d-22a666611b18 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:46.895544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71df6005-4bc6-4e5d-826d-22a666611b18 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:46.895544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71df6005-4bc6-4e5d-826d-22a666611b18 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:46.895972 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71df6005-4bc6-4e5d-826d-22a666611b18 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:46.895972 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-71df6005-4bc6-4e5d-826d-22a666611b18 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:46.974284 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-71df6005-4bc6-4e5d-826d-22a666611b18 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096021 Sep 04 16:20:46.974950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 488/973] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Sep 4 16:20:46 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:20:47.698383 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d3248e1b-f5c4-4a40-a149-f4ec19e0b48e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:47.707261 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d3248e1b-f5c4-4a40-a149-f4ec19e0b48e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:47.707261 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3248e1b-f5c4-4a40-a149-f4ec19e0b48e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:47.707261 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3248e1b-f5c4-4a40-a149-f4ec19e0b48e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:47.707261 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3248e1b-f5c4-4a40-a149-f4ec19e0b48e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:47.707734 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3248e1b-f5c4-4a40-a149-f4ec19e0b48e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:47.707951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3248e1b-f5c4-4a40-a149-f4ec19e0b48e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:47.708379 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3248e1b-f5c4-4a40-a149-f4ec19e0b48e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:47.918885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d3248e1b-f5c4-4a40-a149-f4ec19e0b48e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:47.928582 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d3248e1b-f5c4-4a40-a149-f4ec19e0b48e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:47.930144 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-d3248e1b-f5c4-4a40-a149-f4ec19e0b48e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:47.931301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d3248e1b-f5c4-4a40-a149-f4ec19e0b48e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1675 microversion: 2.20 time: 0.236923 Sep 04 16:20:47.931855 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 486/974] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:47 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1675 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:48.126128 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-eb4ef5b3-7211-4cd3-a4c4-5e64f6052dd9 req-04b183a8-5ba7-4f1b-a258-8d7cfac9edfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca19c96e-1c3a-4bb3-875a-a16eb18f59b4", "tag": "9501fe5b-4b6e-4acf-abe4-45f64425a768"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:20:48.137099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-eb4ef5b3-7211-4cd3-a4c4-5e64f6052dd9 req-04b183a8-5ba7-4f1b-a258-8d7cfac9edfa service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:48.137705 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-eb4ef5b3-7211-4cd3-a4c4-5e64f6052dd9 req-04b183a8-5ba7-4f1b-a258-8d7cfac9edfa service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:48.138144 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-eb4ef5b3-7211-4cd3-a4c4-5e64f6052dd9 req-04b183a8-5ba7-4f1b-a258-8d7cfac9edfa service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:48.154983 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-eb4ef5b3-7211-4cd3-a4c4-5e64f6052dd9 req-04b183a8-5ba7-4f1b-a258-8d7cfac9edfa service nova] Creating event network-changed:9501fe5b-4b6e-4acf-abe4-45f64425a768 for instance ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 on hv-cinder-85236 Sep 04 16:20:48.160978 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-eb4ef5b3-7211-4cd3-a4c4-5e64f6052dd9 req-04b183a8-5ba7-4f1b-a258-8d7cfac9edfa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038753 Sep 04 16:20:48.161762 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 489/975] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:20:48.957609 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a0ac79f9-4cbc-4d24-9a0c-e934917761ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:48.958219 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a0ac79f9-4cbc-4d24-9a0c-e934917761ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:48.964653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0ac79f9-4cbc-4d24-9a0c-e934917761ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:48.965547 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0ac79f9-4cbc-4d24-9a0c-e934917761ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:48.966443 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0ac79f9-4cbc-4d24-9a0c-e934917761ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:48.967543 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0ac79f9-4cbc-4d24-9a0c-e934917761ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:48.968229 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0ac79f9-4cbc-4d24-9a0c-e934917761ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:48.969027 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a0ac79f9-4cbc-4d24-9a0c-e934917761ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:49.258578 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a0ac79f9-4cbc-4d24-9a0c-e934917761ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:49.268851 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a0ac79f9-4cbc-4d24-9a0c-e934917761ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:49.270560 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a0ac79f9-4cbc-4d24-9a0c-e934917761ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:49.271900 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a0ac79f9-4cbc-4d24-9a0c-e934917761ce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1731 microversion: 2.20 time: 0.319371 Sep 04 16:20:49.272613 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 487/976] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:48 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1731 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:50.303020 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5a6f5bf0-aef0-48df-b861-f8fc2e160e78 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:50.303656 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5a6f5bf0-aef0-48df-b861-f8fc2e160e78 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:50.309822 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a6f5bf0-aef0-48df-b861-f8fc2e160e78 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:50.310298 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a6f5bf0-aef0-48df-b861-f8fc2e160e78 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:50.310728 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a6f5bf0-aef0-48df-b861-f8fc2e160e78 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:50.311418 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a6f5bf0-aef0-48df-b861-f8fc2e160e78 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:50.311867 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a6f5bf0-aef0-48df-b861-f8fc2e160e78 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:50.312285 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5a6f5bf0-aef0-48df-b861-f8fc2e160e78 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:50.315508 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:20:50.449831 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5a6f5bf0-aef0-48df-b861-f8fc2e160e78 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:50.460464 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5a6f5bf0-aef0-48df-b861-f8fc2e160e78 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:50.461947 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5a6f5bf0-aef0-48df-b861-f8fc2e160e78 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:50.463113 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5a6f5bf0-aef0-48df-b861-f8fc2e160e78 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1731 microversion: 2.20 time: 0.169230 Sep 04 16:20:50.463846 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 490/977] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:50 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:51.489588 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f7c3a086-696e-440d-9ddd-8716f5b0faa2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:51.490288 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f7c3a086-696e-440d-9ddd-8716f5b0faa2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:51.496837 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f7c3a086-696e-440d-9ddd-8716f5b0faa2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:51.497321 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f7c3a086-696e-440d-9ddd-8716f5b0faa2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:51.497790 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f7c3a086-696e-440d-9ddd-8716f5b0faa2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:51.498488 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f7c3a086-696e-440d-9ddd-8716f5b0faa2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:51.498943 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f7c3a086-696e-440d-9ddd-8716f5b0faa2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:51.499367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f7c3a086-696e-440d-9ddd-8716f5b0faa2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:51.655044 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f7c3a086-696e-440d-9ddd-8716f5b0faa2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:51.664546 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f7c3a086-696e-440d-9ddd-8716f5b0faa2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:51.666204 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f7c3a086-696e-440d-9ddd-8716f5b0faa2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:51.667442 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f7c3a086-696e-440d-9ddd-8716f5b0faa2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1731 microversion: 2.20 time: 0.181784 Sep 04 16:20:51.681771 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 488/978] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:51 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:52.694738 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ed6076b8-73f4-4236-8789-00c59b47d16e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:52.695451 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ed6076b8-73f4-4236-8789-00c59b47d16e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:52.702230 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed6076b8-73f4-4236-8789-00c59b47d16e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:52.741466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed6076b8-73f4-4236-8789-00c59b47d16e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:52.741466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed6076b8-73f4-4236-8789-00c59b47d16e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:52.741466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed6076b8-73f4-4236-8789-00c59b47d16e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:52.741466 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed6076b8-73f4-4236-8789-00c59b47d16e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:52.741927 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ed6076b8-73f4-4236-8789-00c59b47d16e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:52.841787 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ed6076b8-73f4-4236-8789-00c59b47d16e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:52.850226 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ed6076b8-73f4-4236-8789-00c59b47d16e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:52.851685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ed6076b8-73f4-4236-8789-00c59b47d16e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:52.852862 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ed6076b8-73f4-4236-8789-00c59b47d16e tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1731 microversion: 2.20 time: 0.164509 Sep 04 16:20:52.853419 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 491/979] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:52 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:53.878567 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-062f35e1-2fb3-4a07-bd7b-483278477a1b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:53.879200 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-062f35e1-2fb3-4a07-bd7b-483278477a1b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:53.885797 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-062f35e1-2fb3-4a07-bd7b-483278477a1b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:53.886284 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-062f35e1-2fb3-4a07-bd7b-483278477a1b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:53.886724 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-062f35e1-2fb3-4a07-bd7b-483278477a1b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:53.887435 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-062f35e1-2fb3-4a07-bd7b-483278477a1b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:53.887879 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-062f35e1-2fb3-4a07-bd7b-483278477a1b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:53.888368 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-062f35e1-2fb3-4a07-bd7b-483278477a1b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:54.033331 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-062f35e1-2fb3-4a07-bd7b-483278477a1b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:54.045887 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-062f35e1-2fb3-4a07-bd7b-483278477a1b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:54.047335 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-062f35e1-2fb3-4a07-bd7b-483278477a1b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:54.048509 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-062f35e1-2fb3-4a07-bd7b-483278477a1b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1731 microversion: 2.20 time: 0.174121 Sep 04 16:20:54.066055 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 489/980] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:53 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:55.076736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2a853ab3-d03e-4782-9012-71f8a5a13ea5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:55.077695 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2a853ab3-d03e-4782-9012-71f8a5a13ea5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:55.085503 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a853ab3-d03e-4782-9012-71f8a5a13ea5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:55.086287 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a853ab3-d03e-4782-9012-71f8a5a13ea5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:55.086730 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a853ab3-d03e-4782-9012-71f8a5a13ea5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:55.087443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a853ab3-d03e-4782-9012-71f8a5a13ea5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:55.087993 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a853ab3-d03e-4782-9012-71f8a5a13ea5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:55.088421 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2a853ab3-d03e-4782-9012-71f8a5a13ea5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:55.271977 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a853ab3-d03e-4782-9012-71f8a5a13ea5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:55.280749 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a853ab3-d03e-4782-9012-71f8a5a13ea5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:55.282224 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2a853ab3-d03e-4782-9012-71f8a5a13ea5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:55.283703 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2a853ab3-d03e-4782-9012-71f8a5a13ea5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1731 microversion: 2.20 time: 0.211627 Sep 04 16:20:55.300898 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 492/981] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:55 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1731 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:56.325940 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1f567e29-389b-4f32-958a-0750c2049751 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:56.325940 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1f567e29-389b-4f32-958a-0750c2049751 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:56.339465 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1f567e29-389b-4f32-958a-0750c2049751 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:56.340034 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1f567e29-389b-4f32-958a-0750c2049751 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:56.341120 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1f567e29-389b-4f32-958a-0750c2049751 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:56.341948 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1f567e29-389b-4f32-958a-0750c2049751 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:56.342481 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1f567e29-389b-4f32-958a-0750c2049751 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:56.342916 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1f567e29-389b-4f32-958a-0750c2049751 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:56.517889 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1f567e29-389b-4f32-958a-0750c2049751 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:56.527928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1f567e29-389b-4f32-958a-0750c2049751 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:56.529844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1f567e29-389b-4f32-958a-0750c2049751 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:56.531240 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1f567e29-389b-4f32-958a-0750c2049751 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1731 microversion: 2.20 time: 0.217813 Sep 04 16:20:56.532268 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 490/982] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:56 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1731 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:57.558692 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bcc4d82b-0e43-4bad-a308-5d44fa6cf6ee tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:57.560242 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bcc4d82b-0e43-4bad-a308-5d44fa6cf6ee tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:57.568324 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bcc4d82b-0e43-4bad-a308-5d44fa6cf6ee tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:57.568920 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bcc4d82b-0e43-4bad-a308-5d44fa6cf6ee tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:57.569442 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bcc4d82b-0e43-4bad-a308-5d44fa6cf6ee tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:57.570165 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bcc4d82b-0e43-4bad-a308-5d44fa6cf6ee tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:57.570626 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bcc4d82b-0e43-4bad-a308-5d44fa6cf6ee tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:57.583186 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bcc4d82b-0e43-4bad-a308-5d44fa6cf6ee tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:57.734095 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-bcc4d82b-0e43-4bad-a308-5d44fa6cf6ee tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:57.748278 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-bcc4d82b-0e43-4bad-a308-5d44fa6cf6ee tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:57.749758 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-bcc4d82b-0e43-4bad-a308-5d44fa6cf6ee tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:57.750932 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bcc4d82b-0e43-4bad-a308-5d44fa6cf6ee tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1731 microversion: 2.20 time: 0.196975 Sep 04 16:20:57.751726 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 493/983] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:57 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:20:58.788780 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ba9e152b-918a-4416-bde7-e3883a13c256 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:20:58.790161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ba9e152b-918a-4416-bde7-e3883a13c256 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:20:58.798247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba9e152b-918a-4416-bde7-e3883a13c256 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:58.798935 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba9e152b-918a-4416-bde7-e3883a13c256 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:58.800056 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba9e152b-918a-4416-bde7-e3883a13c256 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:58.801274 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba9e152b-918a-4416-bde7-e3883a13c256 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:20:58.801935 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba9e152b-918a-4416-bde7-e3883a13c256 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:20:58.802541 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ba9e152b-918a-4416-bde7-e3883a13c256 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:20:58.963257 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ba9e152b-918a-4416-bde7-e3883a13c256 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:58.972449 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ba9e152b-918a-4416-bde7-e3883a13c256 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:58.974026 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ba9e152b-918a-4416-bde7-e3883a13c256 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:20:58.975195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ba9e152b-918a-4416-bde7-e3883a13c256 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1731 microversion: 2.20 time: 0.190851 Sep 04 16:20:58.975753 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 491/984] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:58 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:21:00.003576 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-079b258e-2976-4ab7-816c-a5d8de0609d9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:00.008399 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-079b258e-2976-4ab7-816c-a5d8de0609d9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:00.021336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-079b258e-2976-4ab7-816c-a5d8de0609d9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:00.021336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-079b258e-2976-4ab7-816c-a5d8de0609d9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:00.021609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-079b258e-2976-4ab7-816c-a5d8de0609d9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:00.022151 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-079b258e-2976-4ab7-816c-a5d8de0609d9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:00.022803 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-079b258e-2976-4ab7-816c-a5d8de0609d9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:00.023632 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-079b258e-2976-4ab7-816c-a5d8de0609d9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:00.173954 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-079b258e-2976-4ab7-816c-a5d8de0609d9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:00.182805 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-079b258e-2976-4ab7-816c-a5d8de0609d9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:00.193750 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-079b258e-2976-4ab7-816c-a5d8de0609d9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:00.193750 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-079b258e-2976-4ab7-816c-a5d8de0609d9 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1731 microversion: 2.20 time: 0.186548 Sep 04 16:21:00.193750 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 494/985] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:20:59 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:21:01.167219 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ad75326f-396e-44e8-9a9c-7df685cd658e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-681660327"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:21:01.167894 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ad75326f-396e-44e8-9a9c-7df685cd658e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:01.170267 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:21:01.175005 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad75326f-396e-44e8-9a9c-7df685cd658e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:01.175485 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad75326f-396e-44e8-9a9c-7df685cd658e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:01.175915 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad75326f-396e-44e8-9a9c-7df685cd658e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:01.176599 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad75326f-396e-44e8-9a9c-7df685cd658e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:01.177046 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad75326f-396e-44e8-9a9c-7df685cd658e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:01.177466 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ad75326f-396e-44e8-9a9c-7df685cd658e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:01.212375 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c74eac2d-58df-4b25-a495-c0351fe8dc8b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:01.214308 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c74eac2d-58df-4b25-a495-c0351fe8dc8b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:01.222268 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c74eac2d-58df-4b25-a495-c0351fe8dc8b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:01.222912 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c74eac2d-58df-4b25-a495-c0351fe8dc8b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:01.223460 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c74eac2d-58df-4b25-a495-c0351fe8dc8b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:01.224241 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c74eac2d-58df-4b25-a495-c0351fe8dc8b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:01.224815 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c74eac2d-58df-4b25-a495-c0351fe8dc8b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:01.226014 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c74eac2d-58df-4b25-a495-c0351fe8dc8b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:01.352579 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.network.security_group_api [None req-ad75326f-396e-44e8-9a9c-7df685cd658e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Removing security group 6b43c59d-2f27-4597-acd9-80f09a1d361f from port 156cd70b-43a3-4b2d-899b-983cd2ad0541 Sep 04 16:21:01.447951 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c74eac2d-58df-4b25-a495-c0351fe8dc8b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:01.456212 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c74eac2d-58df-4b25-a495-c0351fe8dc8b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:01.459787 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c74eac2d-58df-4b25-a495-c0351fe8dc8b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:01.459787 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c74eac2d-58df-4b25-a495-c0351fe8dc8b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1731 microversion: 2.20 time: 0.251656 Sep 04 16:21:01.466991 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 495/986] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:21:01 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1731 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:21:01.815822 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ad75326f-396e-44e8-9a9c-7df685cd658e tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "POST /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6/action" status: 202 len: 0 microversion: 2.1 time: 0.651568 Sep 04 16:21:01.815822 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 492/987] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Sep 4 16:21:01 2022] POST /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6/action => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 04 16:21:01.825076 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-2139590f-c308-432a-8d29-fd935c4b55e1 req-201fa9bb-f9a5-426f-863f-16bb5a4dfbfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1c47389-a373-46bc-8601-5a0038fa00c6", "tag": "156cd70b-43a3-4b2d-899b-983cd2ad0541"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:21:01.845415 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2139590f-c308-432a-8d29-fd935c4b55e1 req-201fa9bb-f9a5-426f-863f-16bb5a4dfbfd service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:01.845966 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2139590f-c308-432a-8d29-fd935c4b55e1 req-201fa9bb-f9a5-426f-863f-16bb5a4dfbfd service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:01.846402 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2139590f-c308-432a-8d29-fd935c4b55e1 req-201fa9bb-f9a5-426f-863f-16bb5a4dfbfd service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:01.859918 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-2139590f-c308-432a-8d29-fd935c4b55e1 req-201fa9bb-f9a5-426f-863f-16bb5a4dfbfd service nova] Creating event network-changed:156cd70b-43a3-4b2d-899b-983cd2ad0541 for instance b1c47389-a373-46bc-8601-5a0038fa00c6 on hv-cinder-85236 Sep 04 16:21:01.867255 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-2139590f-c308-432a-8d29-fd935c4b55e1 req-201fa9bb-f9a5-426f-863f-16bb5a4dfbfd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045416 Sep 04 16:21:01.868276 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 496/988] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:21:02.485073 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-29829f77-3569-460e-bc0a-6cb6572151b1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:02.485987 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-29829f77-3569-460e-bc0a-6cb6572151b1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:02.493863 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29829f77-3569-460e-bc0a-6cb6572151b1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:02.494359 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29829f77-3569-460e-bc0a-6cb6572151b1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:02.494791 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29829f77-3569-460e-bc0a-6cb6572151b1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:02.495672 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29829f77-3569-460e-bc0a-6cb6572151b1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:02.496493 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29829f77-3569-460e-bc0a-6cb6572151b1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:02.496916 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29829f77-3569-460e-bc0a-6cb6572151b1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:02.632865 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-29829f77-3569-460e-bc0a-6cb6572151b1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:02.641143 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-29829f77-3569-460e-bc0a-6cb6572151b1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:02.642668 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-29829f77-3569-460e-bc0a-6cb6572151b1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:02.643826 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-29829f77-3569-460e-bc0a-6cb6572151b1 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1731 microversion: 2.20 time: 0.163434 Sep 04 16:21:02.644381 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 493/989] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:21:02 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:21:03.219746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0da26bfc-3f01-42a8-9fbf-bbc529433770 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:03.220815 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0da26bfc-3f01-42a8-9fbf-bbc529433770 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:03.226659 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-88a75508-6ae8-4897-a5be-34ad49bad26e req-8c21cb94-9810-40ef-bf57-1e1823fc586e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1c47389-a373-46bc-8601-5a0038fa00c6", "tag": "156cd70b-43a3-4b2d-899b-983cd2ad0541"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:21:03.227913 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=59 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:21:03.229857 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0da26bfc-3f01-42a8-9fbf-bbc529433770 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:03.235309 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0da26bfc-3f01-42a8-9fbf-bbc529433770 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:03.235309 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0da26bfc-3f01-42a8-9fbf-bbc529433770 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:03.235309 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0da26bfc-3f01-42a8-9fbf-bbc529433770 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:03.235309 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0da26bfc-3f01-42a8-9fbf-bbc529433770 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:03.235658 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0da26bfc-3f01-42a8-9fbf-bbc529433770 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:03.243899 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-88a75508-6ae8-4897-a5be-34ad49bad26e req-8c21cb94-9810-40ef-bf57-1e1823fc586e service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:03.244378 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-88a75508-6ae8-4897-a5be-34ad49bad26e req-8c21cb94-9810-40ef-bf57-1e1823fc586e service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:03.244809 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-88a75508-6ae8-4897-a5be-34ad49bad26e req-8c21cb94-9810-40ef-bf57-1e1823fc586e service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:03.258132 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-88a75508-6ae8-4897-a5be-34ad49bad26e req-8c21cb94-9810-40ef-bf57-1e1823fc586e service nova] Creating event network-changed:156cd70b-43a3-4b2d-899b-983cd2ad0541 for instance b1c47389-a373-46bc-8601-5a0038fa00c6 on hv-cinder-85236 Sep 04 16:21:03.269673 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-88a75508-6ae8-4897-a5be-34ad49bad26e req-8c21cb94-9810-40ef-bf57-1e1823fc586e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043673 Sep 04 16:21:03.269673 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 494/990] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:21:03.320867 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-0da26bfc-3f01-42a8-9fbf-bbc529433770 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lazy-loading 'services' on Instance uuid b1c47389-a373-46bc-8601-5a0038fa00c6 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:21:03.534313 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0da26bfc-3f01-42a8-9fbf-bbc529433770 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6/os-volume_attachments/3bc9790f-1243-477e-85cf-76f68b1caad7" status: 202 len: 0 microversion: 2.1 time: 0.319834 Sep 04 16:21:03.546676 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-10c16fea-b2fb-4c17-a26e-72b85f384a00 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:03.550506 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-10c16fea-b2fb-4c17-a26e-72b85f384a00 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:03.551113 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 497/991] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Sep 4 16:21:03 2022] DELETE /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6/os-volume_attachments/3bc9790f-1243-477e-85cf-76f68b1caad7 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:21:03.560514 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10c16fea-b2fb-4c17-a26e-72b85f384a00 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:03.566154 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10c16fea-b2fb-4c17-a26e-72b85f384a00 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:03.566154 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10c16fea-b2fb-4c17-a26e-72b85f384a00 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:03.566154 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10c16fea-b2fb-4c17-a26e-72b85f384a00 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:03.566154 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10c16fea-b2fb-4c17-a26e-72b85f384a00 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:03.566549 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10c16fea-b2fb-4c17-a26e-72b85f384a00 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:03.603691 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-10c16fea-b2fb-4c17-a26e-72b85f384a00 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063061 Sep 04 16:21:03.608619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 495/992] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:21:03 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:21:03.676504 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d70f4de0-0788-4cc6-9256-d452fb296064 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:03.679325 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d70f4de0-0788-4cc6-9256-d452fb296064 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:03.712872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d70f4de0-0788-4cc6-9256-d452fb296064 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:03.713650 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d70f4de0-0788-4cc6-9256-d452fb296064 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:03.714048 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d70f4de0-0788-4cc6-9256-d452fb296064 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:03.716181 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d70f4de0-0788-4cc6-9256-d452fb296064 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:03.716722 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d70f4de0-0788-4cc6-9256-d452fb296064 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:03.718934 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d70f4de0-0788-4cc6-9256-d452fb296064 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:03.939454 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d70f4de0-0788-4cc6-9256-d452fb296064 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:03.945782 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d70f4de0-0788-4cc6-9256-d452fb296064 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:03.945969 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d70f4de0-0788-4cc6-9256-d452fb296064 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:03.947223 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d70f4de0-0788-4cc6-9256-d452fb296064 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1731 microversion: 2.20 time: 0.278875 Sep 04 16:21:03.947777 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 498/993] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:21:03 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1731 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:21:04.617199 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-469d947f-c4b1-4cbb-a083-def4c0f3dcac tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:04.619948 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-469d947f-c4b1-4cbb-a083-def4c0f3dcac tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:04.628729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-469d947f-c4b1-4cbb-a083-def4c0f3dcac tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:04.629208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-469d947f-c4b1-4cbb-a083-def4c0f3dcac tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:04.630234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-469d947f-c4b1-4cbb-a083-def4c0f3dcac tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:04.632337 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-469d947f-c4b1-4cbb-a083-def4c0f3dcac tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:04.632820 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-469d947f-c4b1-4cbb-a083-def4c0f3dcac tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:04.633245 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-469d947f-c4b1-4cbb-a083-def4c0f3dcac tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:04.665037 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-469d947f-c4b1-4cbb-a083-def4c0f3dcac tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052629 Sep 04 16:21:04.665613 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 496/994] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:21:04 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:21:04.982203 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d3d92b94-be72-4e12-a79c-b7a4b5336734 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:04.982203 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d3d92b94-be72-4e12-a79c-b7a4b5336734 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:04.982203 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3d92b94-be72-4e12-a79c-b7a4b5336734 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:04.982203 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3d92b94-be72-4e12-a79c-b7a4b5336734 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:04.982858 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3d92b94-be72-4e12-a79c-b7a4b5336734 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:04.982858 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3d92b94-be72-4e12-a79c-b7a4b5336734 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:04.982858 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3d92b94-be72-4e12-a79c-b7a4b5336734 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:04.982858 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3d92b94-be72-4e12-a79c-b7a4b5336734 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:05.123458 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d3d92b94-be72-4e12-a79c-b7a4b5336734 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:05.131919 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d3d92b94-be72-4e12-a79c-b7a4b5336734 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:05.137184 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d3d92b94-be72-4e12-a79c-b7a4b5336734 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:05.137184 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d3d92b94-be72-4e12-a79c-b7a4b5336734 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1731 microversion: 2.20 time: 0.165768 Sep 04 16:21:05.137184 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 499/995] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:21:04 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:21:05.677416 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a6fa5236-fc16-493a-a427-ec06a9d02234 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:05.680348 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a6fa5236-fc16-493a-a427-ec06a9d02234 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:05.686785 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a6fa5236-fc16-493a-a427-ec06a9d02234 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:05.687270 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a6fa5236-fc16-493a-a427-ec06a9d02234 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:05.687703 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a6fa5236-fc16-493a-a427-ec06a9d02234 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:05.688397 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a6fa5236-fc16-493a-a427-ec06a9d02234 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:05.688849 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a6fa5236-fc16-493a-a427-ec06a9d02234 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:05.689273 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a6fa5236-fc16-493a-a427-ec06a9d02234 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:05.719651 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a6fa5236-fc16-493a-a427-ec06a9d02234 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046245 Sep 04 16:21:05.720240 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 497/996] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:21:05 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 04 16:21:05.730929 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b5064928-7ed2-47ed-b017-0c1765a6bd67 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:05.731428 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b5064928-7ed2-47ed-b017-0c1765a6bd67 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:05.737449 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5064928-7ed2-47ed-b017-0c1765a6bd67 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:05.737983 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5064928-7ed2-47ed-b017-0c1765a6bd67 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:05.738442 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5064928-7ed2-47ed-b017-0c1765a6bd67 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:05.739114 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5064928-7ed2-47ed-b017-0c1765a6bd67 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:05.739560 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5064928-7ed2-47ed-b017-0c1765a6bd67 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:05.739994 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b5064928-7ed2-47ed-b017-0c1765a6bd67 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:05.829722 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-b5064928-7ed2-47ed-b017-0c1765a6bd67 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] HTTP exception thrown: Instance b1c47389-a373-46bc-8601-5a0038fa00c6 is not attached to volume 3bc9790f-1243-477e-85cf-76f68b1caad7 Sep 04 16:21:05.836446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b5064928-7ed2-47ed-b017-0c1765a6bd67 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Request method failure captured: Sep 04 16:21:05.836446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6/os-volume_attachments/3bc9790f-1243-477e-85cf-76f68b1caad7 HTTP/1.1 Sep 04 16:21:05.836446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:21:05.836446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:21:05.836446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:21:05.836446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 04 16:21:05.836446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:21:05.836446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:21:05.836446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:21:05.836446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:21:05.836446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFM_QCKWZeVHd6CVGX1AxIlxnd_3vke4c-ZqFGtYDZpvFrqv25WHgY8UbkkTYapYAgSQwZf2BSpdd7wJnUro3dH9jKuv3T-gZFJuGRIYXZqTTJFJLCrX8SM4rlDZDOMA29HpxOQyoG0cDgbCk5V0nsH7Fg_m3xw4HQ9aKs_q9130_xMk Sep 04 16:21:05.836446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:21:05.836446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:21:05.836446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:21:05.836446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:21:05.836446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:21:05.836446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:21:05.836446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: ae092c3124e9438fa20dfda624775825 Sep 04 16:21:05.836446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-TestMinimumBasicScenario-513809684 Sep 04 16:21:05.836446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:21:05.836446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:21:05.838056 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ae092c3124e9438fa20dfda624775825"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ae092c3124e9438fa20dfda624775825"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ae092c3124e9438fa20dfda624775825", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ae092c3124e9438fa20dfda624775825"}]}] Sep 04 16:21:05.838056 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-TestMinimumBasicScenario-513809684 Sep 04 16:21:05.838056 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: ae092c3124e9438fa20dfda624775825 Sep 04 16:21:05.838056 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestMinimumBasicScenario-513809684 Sep 04 16:21:05.838056 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-TestMinimumBasicScenario-513809684-project Sep 04 16:21:05.838056 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:21:05.838056 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:21:05.838056 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: 9b17d0d51b034064a98bdae4bbc20fb6 Sep 04 16:21:05.838056 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-TestMinimumBasicScenario-513809684-project Sep 04 16:21:05.838056 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: > Sep 04 16:21:05.838056 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Instance b1c47389-a373-46bc-8601-5a0038fa00c6 is not attached to volume 3bc9790f-1243-477e-85cf-76f68b1caad7 Sep 04 16:21:05.838807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'server_id': 'b1c47389-a373-46bc-8601-5a0038fa00c6', 'id': '3bc9790f-1243-477e-85cf-76f68b1caad7'} Sep 04 16:21:05.838807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:21:05.838807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:05.838807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 04 16:21:05.838807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 04 16:21:05.838807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 04 16:21:05.838807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 04 16:21:05.838807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 04 16:21:05.838807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 04 16:21:05.838807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3bc9790f-1243-477e-85cf-76f68b1caad7. Sep 04 16:21:05.838807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:05.838807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:05.838807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:05.838807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:05.838807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:05.838807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:05.838807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:21:05.838807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:21:05.838807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:21:05.840058 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:21:05.840058 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 04 16:21:05.840058 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 04 16:21:05.840058 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1c47389-a373-46bc-8601-5a0038fa00c6 is not attached to volume 3bc9790f-1243-477e-85cf-76f68b1caad7 Sep 04 16:21:05.840058 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:05.840058 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:05.840058 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:05.840058 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:05.840058 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:05.840058 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:05.840058 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:21:05.840058 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:21:05.840058 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1c47389-a373-46bc-8601-5a0038fa00c6 is not attached to volume 3bc9790f-1243-477e-85cf-76f68b1caad7 Sep 04 16:21:05.840058 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:05.840058 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b5064928-7ed2-47ed-b017-0c1765a6bd67 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Returning 404 to user: Instance b1c47389-a373-46bc-8601-5a0038fa00c6 is not attached to volume 3bc9790f-1243-477e-85cf-76f68b1caad7 {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:21:05.841039 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b5064928-7ed2-47ed-b017-0c1765a6bd67 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6/os-volume_attachments/3bc9790f-1243-477e-85cf-76f68b1caad7" status: 404 len: 154 microversion: 2.1 time: 0.111461 Sep 04 16:21:05.841039 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 500/997] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Sep 4 16:21:05 2022] DELETE /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6/os-volume_attachments/3bc9790f-1243-477e-85cf-76f68b1caad7 => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:21:06.160532 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b3376365-89cb-432d-ad91-f75b396ce83c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:06.161138 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b3376365-89cb-432d-ad91-f75b396ce83c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:06.167304 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3376365-89cb-432d-ad91-f75b396ce83c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:06.170470 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3376365-89cb-432d-ad91-f75b396ce83c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:06.170470 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3376365-89cb-432d-ad91-f75b396ce83c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:06.170470 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3376365-89cb-432d-ad91-f75b396ce83c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:06.170470 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3376365-89cb-432d-ad91-f75b396ce83c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:06.170793 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b3376365-89cb-432d-ad91-f75b396ce83c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:06.310434 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b3376365-89cb-432d-ad91-f75b396ce83c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:06.319894 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b3376365-89cb-432d-ad91-f75b396ce83c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:06.321210 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b3376365-89cb-432d-ad91-f75b396ce83c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:06.322416 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b3376365-89cb-432d-ad91-f75b396ce83c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1731 microversion: 2.20 time: 0.166029 Sep 04 16:21:06.322970 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 498/998] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:21:06 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:21:06.635015 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-591975bd-4e8c-44a3-b7d4-638acae31e96 req-cd38ae4d-3694-41a1-abab-caeab3cb1396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73", "name": "network-vif-plugged", "status": "completed", "tag": "6d210ca9-1ff4-4f3e-842e-652e252e69a7"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:21:06.647319 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-591975bd-4e8c-44a3-b7d4-638acae31e96 req-cd38ae4d-3694-41a1-abab-caeab3cb1396 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:06.647966 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-591975bd-4e8c-44a3-b7d4-638acae31e96 req-cd38ae4d-3694-41a1-abab-caeab3cb1396 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:06.648645 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-591975bd-4e8c-44a3-b7d4-638acae31e96 req-cd38ae4d-3694-41a1-abab-caeab3cb1396 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:06.659672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-591975bd-4e8c-44a3-b7d4-638acae31e96 req-cd38ae4d-3694-41a1-abab-caeab3cb1396 service nova] Creating event network-vif-plugged:6d210ca9-1ff4-4f3e-842e-652e252e69a7 for instance ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 on hv-cinder-85236 Sep 04 16:21:06.665282 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-591975bd-4e8c-44a3-b7d4-638acae31e96 req-cd38ae4d-3694-41a1-abab-caeab3cb1396 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036806 Sep 04 16:21:06.665926 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 501/999] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:21:07.285883 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-20c7bd1f-0661-4f8d-9873-d0bcdc708bec tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:07.286443 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-20c7bd1f-0661-4f8d-9873-d0bcdc708bec tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:07.293349 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20c7bd1f-0661-4f8d-9873-d0bcdc708bec tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:07.295285 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20c7bd1f-0661-4f8d-9873-d0bcdc708bec tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:07.295285 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20c7bd1f-0661-4f8d-9873-d0bcdc708bec tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:07.295285 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20c7bd1f-0661-4f8d-9873-d0bcdc708bec tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:07.295605 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20c7bd1f-0661-4f8d-9873-d0bcdc708bec tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:07.295780 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20c7bd1f-0661-4f8d-9873-d0bcdc708bec tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:07.321305 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-20c7bd1f-0661-4f8d-9873-d0bcdc708bec tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 16:21:07.348360 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4c7bcf4f-e5b6-415e-af79-41f45964926c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:07.349090 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4c7bcf4f-e5b6-415e-af79-41f45964926c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:07.356208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:21:07.356395 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c7bcf4f-e5b6-415e-af79-41f45964926c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:07.356682 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c7bcf4f-e5b6-415e-af79-41f45964926c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:07.357112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c7bcf4f-e5b6-415e-af79-41f45964926c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:07.357820 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c7bcf4f-e5b6-415e-af79-41f45964926c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:07.358274 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c7bcf4f-e5b6-415e-af79-41f45964926c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:07.358686 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c7bcf4f-e5b6-415e-af79-41f45964926c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:07.491879 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4c7bcf4f-e5b6-415e-af79-41f45964926c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:07.500499 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4c7bcf4f-e5b6-415e-af79-41f45964926c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:07.501970 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4c7bcf4f-e5b6-415e-af79-41f45964926c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:07.503271 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4c7bcf4f-e5b6-415e-af79-41f45964926c tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1731 microversion: 2.20 time: 0.159048 Sep 04 16:21:07.503828 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 502/1000] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:21:07 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:21:07.662879 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-20c7bd1f-0661-4f8d-9873-d0bcdc708bec tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 204 len: 0 microversion: 2.1 time: 0.380490 Sep 04 16:21:07.663472 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 499/1001] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:21:07 2022] DELETE /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 16:21:07.671655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bffe8578-ecdf-428d-9ac0-d466c809cb6f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:07.677682 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bffe8578-ecdf-428d-9ac0-d466c809cb6f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:07.679535 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bffe8578-ecdf-428d-9ac0-d466c809cb6f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:07.680087 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bffe8578-ecdf-428d-9ac0-d466c809cb6f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:07.680524 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bffe8578-ecdf-428d-9ac0-d466c809cb6f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:07.681209 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bffe8578-ecdf-428d-9ac0-d466c809cb6f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:07.681692 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bffe8578-ecdf-428d-9ac0-d466c809cb6f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:07.682122 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bffe8578-ecdf-428d-9ac0-d466c809cb6f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:07.809767 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-bffe8578-ecdf-428d-9ac0-d466c809cb6f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:07.818387 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bffe8578-ecdf-428d-9ac0-d466c809cb6f tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1555 microversion: 2.1 time: 0.150545 Sep 04 16:21:07.821738 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 503/1002] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:21:07 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:21:08.529516 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-50d4c801-7055-4e4e-9db0-c879c5e46185 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:08.530230 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-50d4c801-7055-4e4e-9db0-c879c5e46185 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:08.536718 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-50d4c801-7055-4e4e-9db0-c879c5e46185 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:08.540270 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-50d4c801-7055-4e4e-9db0-c879c5e46185 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:08.540270 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-50d4c801-7055-4e4e-9db0-c879c5e46185 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:08.540270 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-50d4c801-7055-4e4e-9db0-c879c5e46185 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:08.540270 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-50d4c801-7055-4e4e-9db0-c879c5e46185 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:08.540662 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-50d4c801-7055-4e4e-9db0-c879c5e46185 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:08.670975 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-50d4c801-7055-4e4e-9db0-c879c5e46185 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:08.678989 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-50d4c801-7055-4e4e-9db0-c879c5e46185 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:08.680943 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-50d4c801-7055-4e4e-9db0-c879c5e46185 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:08.682121 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-50d4c801-7055-4e4e-9db0-c879c5e46185 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1731 microversion: 2.20 time: 0.156891 Sep 04 16:21:08.682678 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 500/1003] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:21:08 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:21:08.842766 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2dc2c663-191c-49dd-80c8-64e48abf7dce tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:08.843397 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2dc2c663-191c-49dd-80c8-64e48abf7dce tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:08.849825 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2dc2c663-191c-49dd-80c8-64e48abf7dce tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:08.850307 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2dc2c663-191c-49dd-80c8-64e48abf7dce tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:08.850734 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2dc2c663-191c-49dd-80c8-64e48abf7dce tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:08.851413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2dc2c663-191c-49dd-80c8-64e48abf7dce tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:08.851859 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2dc2c663-191c-49dd-80c8-64e48abf7dce tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:08.852822 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2dc2c663-191c-49dd-80c8-64e48abf7dce tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:08.983719 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2dc2c663-191c-49dd-80c8-64e48abf7dce tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:08.991481 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2dc2c663-191c-49dd-80c8-64e48abf7dce tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1555 microversion: 2.1 time: 0.152692 Sep 04 16:21:08.992118 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 504/1004] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:21:08 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:21:09.708342 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9dc59101-8591-4dd8-9039-4fdf1fa0b292 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:09.708883 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9dc59101-8591-4dd8-9039-4fdf1fa0b292 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:09.716057 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9dc59101-8591-4dd8-9039-4fdf1fa0b292 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:09.716538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9dc59101-8591-4dd8-9039-4fdf1fa0b292 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:09.716974 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9dc59101-8591-4dd8-9039-4fdf1fa0b292 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:09.717687 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9dc59101-8591-4dd8-9039-4fdf1fa0b292 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:09.718143 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9dc59101-8591-4dd8-9039-4fdf1fa0b292 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:09.718569 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9dc59101-8591-4dd8-9039-4fdf1fa0b292 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:09.847367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9dc59101-8591-4dd8-9039-4fdf1fa0b292 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:09.855552 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9dc59101-8591-4dd8-9039-4fdf1fa0b292 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:09.857001 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9dc59101-8591-4dd8-9039-4fdf1fa0b292 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:09.858199 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9dc59101-8591-4dd8-9039-4fdf1fa0b292 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1731 microversion: 2.20 time: 0.153901 Sep 04 16:21:09.858751 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 501/1005] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:21:09 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:21:10.015333 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9965a297-a969-489f-99be-c31adb0d3a81 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:10.015872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9965a297-a969-489f-99be-c31adb0d3a81 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:10.022739 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9965a297-a969-489f-99be-c31adb0d3a81 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:10.031280 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9965a297-a969-489f-99be-c31adb0d3a81 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:10.031280 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9965a297-a969-489f-99be-c31adb0d3a81 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:10.031280 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9965a297-a969-489f-99be-c31adb0d3a81 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:10.031280 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9965a297-a969-489f-99be-c31adb0d3a81 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:10.031686 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9965a297-a969-489f-99be-c31adb0d3a81 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:10.150956 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-9965a297-a969-489f-99be-c31adb0d3a81 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:10.158638 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9965a297-a969-489f-99be-c31adb0d3a81 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1555 microversion: 2.1 time: 0.147313 Sep 04 16:21:10.159193 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 505/1006] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:21:10 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1555 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:21:10.884061 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7713e17f-258d-4fec-ae6a-74037e54dfce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:10.884634 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7713e17f-258d-4fec-ae6a-74037e54dfce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:10.891115 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7713e17f-258d-4fec-ae6a-74037e54dfce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:10.891622 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7713e17f-258d-4fec-ae6a-74037e54dfce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:10.892056 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7713e17f-258d-4fec-ae6a-74037e54dfce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:10.892741 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7713e17f-258d-4fec-ae6a-74037e54dfce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:10.893192 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7713e17f-258d-4fec-ae6a-74037e54dfce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:10.893638 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7713e17f-258d-4fec-ae6a-74037e54dfce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:11.025888 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7713e17f-258d-4fec-ae6a-74037e54dfce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:11.033967 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7713e17f-258d-4fec-ae6a-74037e54dfce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:11.035415 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7713e17f-258d-4fec-ae6a-74037e54dfce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:11.036577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7713e17f-258d-4fec-ae6a-74037e54dfce tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1731 microversion: 2.20 time: 0.156845 Sep 04 16:21:11.037138 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 502/1007] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:21:10 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:21:11.181866 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aede49fc-d92f-433e-bda5-8c86f844b4f2 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:11.182386 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aede49fc-d92f-433e-bda5-8c86f844b4f2 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:11.188448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aede49fc-d92f-433e-bda5-8c86f844b4f2 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:11.188922 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aede49fc-d92f-433e-bda5-8c86f844b4f2 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:11.189355 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aede49fc-d92f-433e-bda5-8c86f844b4f2 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:11.190057 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aede49fc-d92f-433e-bda5-8c86f844b4f2 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:11.190505 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aede49fc-d92f-433e-bda5-8c86f844b4f2 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:11.190921 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aede49fc-d92f-433e-bda5-8c86f844b4f2 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:11.336807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-aede49fc-d92f-433e-bda5-8c86f844b4f2 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:11.344448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aede49fc-d92f-433e-bda5-8c86f844b4f2 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1555 microversion: 2.1 time: 0.166781 Sep 04 16:21:11.345009 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 506/1008] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:21:11 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:21:12.062574 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ccd5a63b-899d-4a53-b18e-2d0d895c50c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:12.063228 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ccd5a63b-899d-4a53-b18e-2d0d895c50c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:12.069739 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ccd5a63b-899d-4a53-b18e-2d0d895c50c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:12.070212 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ccd5a63b-899d-4a53-b18e-2d0d895c50c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:12.070649 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ccd5a63b-899d-4a53-b18e-2d0d895c50c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:12.072065 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ccd5a63b-899d-4a53-b18e-2d0d895c50c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:12.072512 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ccd5a63b-899d-4a53-b18e-2d0d895c50c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:12.072931 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ccd5a63b-899d-4a53-b18e-2d0d895c50c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:12.205102 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ccd5a63b-899d-4a53-b18e-2d0d895c50c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:12.213948 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ccd5a63b-899d-4a53-b18e-2d0d895c50c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:12.215425 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ccd5a63b-899d-4a53-b18e-2d0d895c50c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:12.216599 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ccd5a63b-899d-4a53-b18e-2d0d895c50c3 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1731 microversion: 2.20 time: 0.157911 Sep 04 16:21:12.217165 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 503/1009] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:21:12 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:21:12.368717 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-45379229-75d1-4a3b-91dd-c338ffbaadf4 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:12.369323 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-45379229-75d1-4a3b-91dd-c338ffbaadf4 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:12.379101 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45379229-75d1-4a3b-91dd-c338ffbaadf4 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:12.379583 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45379229-75d1-4a3b-91dd-c338ffbaadf4 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:12.380014 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45379229-75d1-4a3b-91dd-c338ffbaadf4 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:12.380799 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45379229-75d1-4a3b-91dd-c338ffbaadf4 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:12.381245 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45379229-75d1-4a3b-91dd-c338ffbaadf4 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:12.381920 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-45379229-75d1-4a3b-91dd-c338ffbaadf4 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:12.399642 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:21:12.531557 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-45379229-75d1-4a3b-91dd-c338ffbaadf4 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:12.540506 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-45379229-75d1-4a3b-91dd-c338ffbaadf4 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1555 microversion: 2.1 time: 0.176959 Sep 04 16:21:12.541248 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 507/1010] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:21:12 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:21:13.250705 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5c1b59e4-caa8-408f-9f54-9d1c6f103fbc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:13.251317 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5c1b59e4-caa8-408f-9f54-9d1c6f103fbc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:13.258158 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5c1b59e4-caa8-408f-9f54-9d1c6f103fbc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:13.258642 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5c1b59e4-caa8-408f-9f54-9d1c6f103fbc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:13.259081 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5c1b59e4-caa8-408f-9f54-9d1c6f103fbc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:13.259789 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5c1b59e4-caa8-408f-9f54-9d1c6f103fbc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:13.260245 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5c1b59e4-caa8-408f-9f54-9d1c6f103fbc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:13.260669 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5c1b59e4-caa8-408f-9f54-9d1c6f103fbc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:13.472732 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5c1b59e4-caa8-408f-9f54-9d1c6f103fbc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:13.482520 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5c1b59e4-caa8-408f-9f54-9d1c6f103fbc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:13.484014 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-5c1b59e4-caa8-408f-9f54-9d1c6f103fbc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:13.485185 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5c1b59e4-caa8-408f-9f54-9d1c6f103fbc tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1731 microversion: 2.20 time: 0.238448 Sep 04 16:21:13.487433 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 504/1011] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:21:13 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1731 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:21:13.566502 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7908ff8d-b02e-43bb-8d13-904373832444 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:13.567107 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7908ff8d-b02e-43bb-8d13-904373832444 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:13.574183 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7908ff8d-b02e-43bb-8d13-904373832444 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:13.574663 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7908ff8d-b02e-43bb-8d13-904373832444 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:13.575089 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7908ff8d-b02e-43bb-8d13-904373832444 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:13.575779 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7908ff8d-b02e-43bb-8d13-904373832444 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:13.576231 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7908ff8d-b02e-43bb-8d13-904373832444 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:13.576651 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7908ff8d-b02e-43bb-8d13-904373832444 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:13.764627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-9d61fb95-b460-4c12-bb5c-0555371f54de req-5e626e78-d489-48c4-8f45-eb6327531dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1c47389-a373-46bc-8601-5a0038fa00c6", "name": "network-vif-deleted", "tag": "156cd70b-43a3-4b2d-899b-983cd2ad0541"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:21:13.775237 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-9d61fb95-b460-4c12-bb5c-0555371f54de req-5e626e78-d489-48c4-8f45-eb6327531dad service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:13.778294 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-9d61fb95-b460-4c12-bb5c-0555371f54de req-5e626e78-d489-48c4-8f45-eb6327531dad service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:13.778294 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-9d61fb95-b460-4c12-bb5c-0555371f54de req-5e626e78-d489-48c4-8f45-eb6327531dad service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:13.788115 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-9d61fb95-b460-4c12-bb5c-0555371f54de req-5e626e78-d489-48c4-8f45-eb6327531dad service nova] Creating event network-vif-deleted:156cd70b-43a3-4b2d-899b-983cd2ad0541 for instance b1c47389-a373-46bc-8601-5a0038fa00c6 on hv-cinder-85236 Sep 04 16:21:13.791110 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7908ff8d-b02e-43bb-8d13-904373832444 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:13.793224 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-9d61fb95-b460-4c12-bb5c-0555371f54de req-5e626e78-d489-48c4-8f45-eb6327531dad service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032693 Sep 04 16:21:13.794664 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 505/1012] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:21:13.800494 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7908ff8d-b02e-43bb-8d13-904373832444 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1555 microversion: 2.1 time: 0.238049 Sep 04 16:21:13.801376 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 508/1013] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:21:13 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1555 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:21:14.513604 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9c44e1f3-6925-414d-af80-5e70f0e0a0e5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:14.514294 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9c44e1f3-6925-414d-af80-5e70f0e0a0e5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:14.520839 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9c44e1f3-6925-414d-af80-5e70f0e0a0e5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:14.521309 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9c44e1f3-6925-414d-af80-5e70f0e0a0e5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:14.521769 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9c44e1f3-6925-414d-af80-5e70f0e0a0e5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:14.522452 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9c44e1f3-6925-414d-af80-5e70f0e0a0e5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:14.522895 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9c44e1f3-6925-414d-af80-5e70f0e0a0e5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:14.523314 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9c44e1f3-6925-414d-af80-5e70f0e0a0e5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:14.656622 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9c44e1f3-6925-414d-af80-5e70f0e0a0e5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:14.664908 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9c44e1f3-6925-414d-af80-5e70f0e0a0e5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:14.666516 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9c44e1f3-6925-414d-af80-5e70f0e0a0e5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:14.667713 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9c44e1f3-6925-414d-af80-5e70f0e0a0e5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1718 microversion: 2.20 time: 0.158975 Sep 04 16:21:14.668278 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 506/1014] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:21:14 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:21:14.826611 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-191e2840-0304-4558-ad35-74617044b382 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:14.827209 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-191e2840-0304-4558-ad35-74617044b382 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:14.833514 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-191e2840-0304-4558-ad35-74617044b382 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:14.834020 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-191e2840-0304-4558-ad35-74617044b382 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:14.834450 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-191e2840-0304-4558-ad35-74617044b382 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:14.835131 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-191e2840-0304-4558-ad35-74617044b382 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:14.835573 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-191e2840-0304-4558-ad35-74617044b382 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:14.835987 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-191e2840-0304-4558-ad35-74617044b382 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:14.866095 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-191e2840-0304-4558-ad35-74617044b382 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:14.866491 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-191e2840-0304-4558-ad35-74617044b382 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:14.866918 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-191e2840-0304-4558-ad35-74617044b382 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:14.867350 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-191e2840-0304-4558-ad35-74617044b382 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lazy-loading 'fault' on Instance uuid b1c47389-a373-46bc-8601-5a0038fa00c6 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:21:14.908438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-191e2840-0304-4558-ad35-74617044b382 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:14.916255 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-191e2840-0304-4558-ad35-74617044b382 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1348 microversion: 2.1 time: 0.093583 Sep 04 16:21:14.916811 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 509/1015] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:21:14 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1348 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:21:15.939474 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-71ad3c98-7554-4110-87fd-d10a94eda2cd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:15.940131 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-71ad3c98-7554-4110-87fd-d10a94eda2cd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:15.946274 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71ad3c98-7554-4110-87fd-d10a94eda2cd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:15.946755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71ad3c98-7554-4110-87fd-d10a94eda2cd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:15.947186 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71ad3c98-7554-4110-87fd-d10a94eda2cd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:15.947885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71ad3c98-7554-4110-87fd-d10a94eda2cd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:15.948329 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71ad3c98-7554-4110-87fd-d10a94eda2cd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:15.948747 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71ad3c98-7554-4110-87fd-d10a94eda2cd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:15.980734 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71ad3c98-7554-4110-87fd-d10a94eda2cd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:15.981358 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71ad3c98-7554-4110-87fd-d10a94eda2cd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:15.981820 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-71ad3c98-7554-4110-87fd-d10a94eda2cd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:15.982260 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-71ad3c98-7554-4110-87fd-d10a94eda2cd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lazy-loading 'fault' on Instance uuid b1c47389-a373-46bc-8601-5a0038fa00c6 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:21:16.021885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-71ad3c98-7554-4110-87fd-d10a94eda2cd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:16.034779 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-71ad3c98-7554-4110-87fd-d10a94eda2cd tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1348 microversion: 2.1 time: 0.099165 Sep 04 16:21:16.035361 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 507/1016] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:21:15 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1348 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:21:17.059095 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-84ed0d7d-c340-4b54-a139-240f22e4fcb0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:17.059705 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-84ed0d7d-c340-4b54-a139-240f22e4fcb0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:17.066172 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84ed0d7d-c340-4b54-a139-240f22e4fcb0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:17.066657 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84ed0d7d-c340-4b54-a139-240f22e4fcb0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:17.067091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84ed0d7d-c340-4b54-a139-240f22e4fcb0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:17.067779 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84ed0d7d-c340-4b54-a139-240f22e4fcb0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:17.068230 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84ed0d7d-c340-4b54-a139-240f22e4fcb0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:17.068649 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84ed0d7d-c340-4b54-a139-240f22e4fcb0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:17.100327 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84ed0d7d-c340-4b54-a139-240f22e4fcb0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:17.100844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84ed0d7d-c340-4b54-a139-240f22e4fcb0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:17.101274 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-84ed0d7d-c340-4b54-a139-240f22e4fcb0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:17.101746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-84ed0d7d-c340-4b54-a139-240f22e4fcb0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lazy-loading 'fault' on Instance uuid b1c47389-a373-46bc-8601-5a0038fa00c6 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:21:17.142801 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-84ed0d7d-c340-4b54-a139-240f22e4fcb0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b17d0d51b034064a98bdae4bbc20fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae092c3124e9438fa20dfda624775825', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:17.150716 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-84ed0d7d-c340-4b54-a139-240f22e4fcb0 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 200 len: 1348 microversion: 2.1 time: 0.096342 Sep 04 16:21:17.151267 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 510/1017] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:21:17 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 1348 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:21:18.173820 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a29b0a43-08c1-4e18-8de8-0220a8414b88 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:18.174324 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a29b0a43-08c1-4e18-8de8-0220a8414b88 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] [instance: b1c47389-a373-46bc-8601-5a0038fa00c6] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:18.181749 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a29b0a43-08c1-4e18-8de8-0220a8414b88 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:18.182249 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a29b0a43-08c1-4e18-8de8-0220a8414b88 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:18.182721 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a29b0a43-08c1-4e18-8de8-0220a8414b88 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:18.183386 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a29b0a43-08c1-4e18-8de8-0220a8414b88 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:18.183896 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a29b0a43-08c1-4e18-8de8-0220a8414b88 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:18.184466 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a29b0a43-08c1-4e18-8de8-0220a8414b88 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:18.198655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-a29b0a43-08c1-4e18-8de8-0220a8414b88 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] HTTP exception thrown: Instance b1c47389-a373-46bc-8601-5a0038fa00c6 could not be found. Sep 04 16:21:18.200301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a29b0a43-08c1-4e18-8de8-0220a8414b88 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Request method failure captured: Sep 04 16:21:18.200301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 HTTP/1.1 Sep 04 16:21:18.200301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:21:18.200301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:21:18.200301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:21:18.200301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:21:18.200301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:21:18.200301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:21:18.200301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:21:18.200301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:21:18.200301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFM_QCKWZeVHd6CVGX1AxIlxnd_3vke4c-ZqFGtYDZpvFrqv25WHgY8UbkkTYapYAgSQwZf2BSpdd7wJnUro3dH9jKuv3T-gZFJuGRIYXZqTTJFJLCrX8SM4rlDZDOMA29HpxOQyoG0cDgbCk5V0nsH7Fg_m3xw4HQ9aKs_q9130_xMk Sep 04 16:21:18.200301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:21:18.200301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:21:18.200301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:21:18.200301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:21:18.200301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:21:18.200301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:21:18.200301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: ae092c3124e9438fa20dfda624775825 Sep 04 16:21:18.200301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-TestMinimumBasicScenario-513809684 Sep 04 16:21:18.200301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:21:18.200301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:21:18.201800 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ae092c3124e9438fa20dfda624775825"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ae092c3124e9438fa20dfda624775825"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ae092c3124e9438fa20dfda624775825", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ae092c3124e9438fa20dfda624775825"}]}] Sep 04 16:21:18.201800 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-TestMinimumBasicScenario-513809684 Sep 04 16:21:18.201800 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: ae092c3124e9438fa20dfda624775825 Sep 04 16:21:18.201800 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-TestMinimumBasicScenario-513809684 Sep 04 16:21:18.201800 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-TestMinimumBasicScenario-513809684-project Sep 04 16:21:18.201800 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:21:18.201800 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:21:18.201800 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: 9b17d0d51b034064a98bdae4bbc20fb6 Sep 04 16:21:18.201800 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-TestMinimumBasicScenario-513809684-project Sep 04 16:21:18.201800 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: > Sep 04 16:21:18.201800 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Instance b1c47389-a373-46bc-8601-5a0038fa00c6 could not be found. Sep 04 16:21:18.201800 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': 'b1c47389-a373-46bc-8601-5a0038fa00c6'} Sep 04 16:21:18.202555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:21:18.202555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:18.202555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:21:18.202555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:21:18.202555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:21:18.202555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:21:18.202555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:21:18.202555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:21:18.202555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:21:18.202555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:21:18.202555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1c47389-a373-46bc-8601-5a0038fa00c6 could not be found. Sep 04 16:21:18.202555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:18.202555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:18.202555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:18.202555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:18.202555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:18.202555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:18.202555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:21:18.202555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:21:18.202555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:21:18.203914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:21:18.203914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:21:18.203914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:21:18.203914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:21:18.203914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:21:18.203914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:21:18.203914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:21:18.203914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1c47389-a373-46bc-8601-5a0038fa00c6 could not be found. Sep 04 16:21:18.203914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:18.203914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:18.203914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:18.203914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:18.203914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:18.203914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:18.203914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:21:18.203914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:21:18.203914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1c47389-a373-46bc-8601-5a0038fa00c6 could not be found. Sep 04 16:21:18.203914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:18.205115 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a29b0a43-08c1-4e18-8de8-0220a8414b88 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Returning 404 to user: Instance b1c47389-a373-46bc-8601-5a0038fa00c6 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:21:18.205115 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a29b0a43-08c1-4e18-8de8-0220a8414b88 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6" status: 404 len: 111 microversion: 2.1 time: 0.031899 Sep 04 16:21:18.205115 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 508/1018] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:21:18 2022] GET /compute/v2.1/servers/b1c47389-a373-46bc-8601-5a0038fa00c6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:21:18.210468 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a7230553-d8d0-4d85-8316-5f51d80ecd06 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] Calling method '.version_select at 0x7f96892598b0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:18.306771 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a7230553-d8d0-4d85-8316-5f51d80ecd06 tempest-TestMinimumBasicScenario-513809684 tempest-TestMinimumBasicScenario-513809684-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-451834545" status: 202 len: 0 microversion: 2.1 time: 0.099962 Sep 04 16:21:18.307372 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 511/1019] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Sep 4 16:21:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-451834545 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:21:34.974161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-26e30dfe-8ae8-4ce2-8db4-285deba49ad4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:34.974775 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-26e30dfe-8ae8-4ce2-8db4-285deba49ad4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:34.976865 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:21:34.977526 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:21:34.983243 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26e30dfe-8ae8-4ce2-8db4-285deba49ad4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:34.983732 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26e30dfe-8ae8-4ce2-8db4-285deba49ad4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:34.984176 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26e30dfe-8ae8-4ce2-8db4-285deba49ad4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:34.984868 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26e30dfe-8ae8-4ce2-8db4-285deba49ad4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:34.985331 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26e30dfe-8ae8-4ce2-8db4-285deba49ad4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:34.985798 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-26e30dfe-8ae8-4ce2-8db4-285deba49ad4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:35.009698 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-26e30dfe-8ae8-4ce2-8db4-285deba49ad4 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4/ips" status: 200 len: 150 microversion: 2.1 time: 0.039806 Sep 04 16:21:35.010277 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 509/1020] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Sep 4 16:21:34 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:21:36.587959 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=25 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:21:36.588638 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:21:36.592847 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8eea6f94-4912-4a83-af0e-4cd2cda89527 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1937ca89-9c4c-423f-bcb5-15a676d763ff"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:21:36.595146 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8eea6f94-4912-4a83-af0e-4cd2cda89527 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:36.600807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8eea6f94-4912-4a83-af0e-4cd2cda89527 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:36.609164 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8eea6f94-4912-4a83-af0e-4cd2cda89527 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:36.609164 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8eea6f94-4912-4a83-af0e-4cd2cda89527 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:36.609164 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8eea6f94-4912-4a83-af0e-4cd2cda89527 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:36.609164 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8eea6f94-4912-4a83-af0e-4cd2cda89527 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:36.609610 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8eea6f94-4912-4a83-af0e-4cd2cda89527 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:37.289949 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8eea6f94-4912-4a83-af0e-4cd2cda89527 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "POST /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.703202 Sep 04 16:21:37.290827 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 512/1021] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Sep 4 16:21:36 2022] POST /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:21:44.931439 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-856a15ae-6b99-4aca-a382-b7fbd21502ea tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:44.932038 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-856a15ae-6b99-4aca-a382-b7fbd21502ea tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:44.940435 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-856a15ae-6b99-4aca-a382-b7fbd21502ea tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:44.940919 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-856a15ae-6b99-4aca-a382-b7fbd21502ea tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:44.941351 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-856a15ae-6b99-4aca-a382-b7fbd21502ea tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:44.942084 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-856a15ae-6b99-4aca-a382-b7fbd21502ea tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:44.942720 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-856a15ae-6b99-4aca-a382-b7fbd21502ea tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:44.943143 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-856a15ae-6b99-4aca-a382-b7fbd21502ea tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:45.026688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-856a15ae-6b99-4aca-a382-b7fbd21502ea tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lazy-loading 'services' on Instance uuid ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:21:45.245808 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-856a15ae-6b99-4aca-a382-b7fbd21502ea tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4/os-volume_attachments/1937ca89-9c4c-423f-bcb5-15a676d763ff" status: 202 len: 0 microversion: 2.1 time: 0.318031 Sep 04 16:21:45.246466 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 510/1022] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Sep 4 16:21:44 2022] DELETE /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4/os-volume_attachments/1937ca89-9c4c-423f-bcb5-15a676d763ff => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:21:45.255956 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-bfa44062-fe9b-499a-bcb0-0cf80fd6c31a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:45.258324 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-bfa44062-fe9b-499a-bcb0-0cf80fd6c31a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:45.264907 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfa44062-fe9b-499a-bcb0-0cf80fd6c31a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:45.265511 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfa44062-fe9b-499a-bcb0-0cf80fd6c31a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:45.265982 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfa44062-fe9b-499a-bcb0-0cf80fd6c31a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:45.266909 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfa44062-fe9b-499a-bcb0-0cf80fd6c31a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:45.267390 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfa44062-fe9b-499a-bcb0-0cf80fd6c31a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:45.267842 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-bfa44062-fe9b-499a-bcb0-0cf80fd6c31a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:45.299163 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-bfa44062-fe9b-499a-bcb0-0cf80fd6c31a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048010 Sep 04 16:21:45.299721 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 513/1023] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:21:45 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:21:46.313203 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d6b93b50-968f-4345-b290-0f4ff0e1d94a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:46.315576 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d6b93b50-968f-4345-b290-0f4ff0e1d94a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:46.322274 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d6b93b50-968f-4345-b290-0f4ff0e1d94a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:46.323275 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d6b93b50-968f-4345-b290-0f4ff0e1d94a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:46.323727 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d6b93b50-968f-4345-b290-0f4ff0e1d94a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:46.324432 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d6b93b50-968f-4345-b290-0f4ff0e1d94a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:46.324881 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d6b93b50-968f-4345-b290-0f4ff0e1d94a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:46.325304 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d6b93b50-968f-4345-b290-0f4ff0e1d94a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:46.357467 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d6b93b50-968f-4345-b290-0f4ff0e1d94a tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049341 Sep 04 16:21:46.358068 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 511/1024] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:21:46 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 04 16:21:46.421536 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-840ccb8f-6fed-454f-b989-1a52e1aa0028 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:46.422074 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-840ccb8f-6fed-454f-b989-1a52e1aa0028 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:46.428443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-840ccb8f-6fed-454f-b989-1a52e1aa0028 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:46.429251 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-840ccb8f-6fed-454f-b989-1a52e1aa0028 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:46.429373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-840ccb8f-6fed-454f-b989-1a52e1aa0028 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:46.430040 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-840ccb8f-6fed-454f-b989-1a52e1aa0028 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:46.430491 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-840ccb8f-6fed-454f-b989-1a52e1aa0028 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:46.430907 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-840ccb8f-6fed-454f-b989-1a52e1aa0028 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:46.456554 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-840ccb8f-6fed-454f-b989-1a52e1aa0028 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 16:21:46.752098 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-840ccb8f-6fed-454f-b989-1a52e1aa0028 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4" status: 204 len: 0 microversion: 2.1 time: 0.334722 Sep 04 16:21:46.752658 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 514/1025] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:21:46 2022] DELETE /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 16:21:46.760879 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-84db7975-8827-4f81-bb8e-32e792c88362 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:46.762701 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-84db7975-8827-4f81-bb8e-32e792c88362 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:46.768764 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-84db7975-8827-4f81-bb8e-32e792c88362 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:46.771959 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-84db7975-8827-4f81-bb8e-32e792c88362 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:46.771959 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-84db7975-8827-4f81-bb8e-32e792c88362 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:46.771959 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-84db7975-8827-4f81-bb8e-32e792c88362 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:46.771959 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-84db7975-8827-4f81-bb8e-32e792c88362 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:46.772341 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-84db7975-8827-4f81-bb8e-32e792c88362 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:46.904573 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-84db7975-8827-4f81-bb8e-32e792c88362 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:46.912281 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-84db7975-8827-4f81-bb8e-32e792c88362 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4" status: 200 len: 1681 microversion: 2.1 time: 0.155435 Sep 04 16:21:46.912841 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 512/1026] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:21:46 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:21:47.507250 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-25d1f807-9bc7-4330-ae48-3ad2fd61337b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:47.509542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-25d1f807-9bc7-4330-ae48-3ad2fd61337b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:47.516996 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25d1f807-9bc7-4330-ae48-3ad2fd61337b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:47.517482 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25d1f807-9bc7-4330-ae48-3ad2fd61337b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:47.517953 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25d1f807-9bc7-4330-ae48-3ad2fd61337b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:47.518647 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25d1f807-9bc7-4330-ae48-3ad2fd61337b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:47.519100 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25d1f807-9bc7-4330-ae48-3ad2fd61337b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:47.519522 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-25d1f807-9bc7-4330-ae48-3ad2fd61337b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:47.550762 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-25d1f807-9bc7-4330-ae48-3ad2fd61337b tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047849 Sep 04 16:21:47.551318 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 515/1027] 10.222.0.39 () {60 vars in 1343 bytes} [Sun Sep 4 16:21:47 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:21:47.614895 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d3e83c51-92e6-4a78-a7a2-6675004d653f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:47.615407 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d3e83c51-92e6-4a78-a7a2-6675004d653f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:47.622321 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3e83c51-92e6-4a78-a7a2-6675004d653f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:47.622837 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3e83c51-92e6-4a78-a7a2-6675004d653f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:47.623277 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3e83c51-92e6-4a78-a7a2-6675004d653f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:47.624013 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3e83c51-92e6-4a78-a7a2-6675004d653f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:47.624524 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3e83c51-92e6-4a78-a7a2-6675004d653f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:47.624899 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-d3e83c51-92e6-4a78-a7a2-6675004d653f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:47.653913 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-d3e83c51-92e6-4a78-a7a2-6675004d653f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 16:21:47.936962 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-37292f3a-d304-4b74-b481-5485c5f31a9d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:47.937558 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d3e83c51-92e6-4a78-a7a2-6675004d653f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 204 len: 0 microversion: 2.20 time: 0.326610 Sep 04 16:21:47.937714 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-37292f3a-d304-4b74-b481-5485c5f31a9d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:47.938155 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 513/1028] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Sep 4 16:21:47 2022] DELETE /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 04 16:21:47.943681 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37292f3a-d304-4b74-b481-5485c5f31a9d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:47.944166 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37292f3a-d304-4b74-b481-5485c5f31a9d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:47.945115 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37292f3a-d304-4b74-b481-5485c5f31a9d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:47.945282 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37292f3a-d304-4b74-b481-5485c5f31a9d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:47.945770 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37292f3a-d304-4b74-b481-5485c5f31a9d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:47.946192 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37292f3a-d304-4b74-b481-5485c5f31a9d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:47.946451 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-67c96414-6de2-416b-b0ed-b3ab05733653 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:47.947140 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-67c96414-6de2-416b-b0ed-b3ab05733653 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:47.953538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-67c96414-6de2-416b-b0ed-b3ab05733653 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:47.954053 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-67c96414-6de2-416b-b0ed-b3ab05733653 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:47.954483 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-67c96414-6de2-416b-b0ed-b3ab05733653 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:47.955168 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-67c96414-6de2-416b-b0ed-b3ab05733653 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:47.955612 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-67c96414-6de2-416b-b0ed-b3ab05733653 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:47.956111 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-67c96414-6de2-416b-b0ed-b3ab05733653 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:48.153744 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-37292f3a-d304-4b74-b481-5485c5f31a9d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:48.156785 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-67c96414-6de2-416b-b0ed-b3ab05733653 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:48.162734 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-37292f3a-d304-4b74-b481-5485c5f31a9d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4" status: 200 len: 1681 microversion: 2.1 time: 0.229872 Sep 04 16:21:48.163308 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 516/1029] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:21:47 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 => generated 1681 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:21:48.167132 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-67c96414-6de2-416b-b0ed-b3ab05733653 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:48.171007 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-67c96414-6de2-416b-b0ed-b3ab05733653 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:48.172198 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-67c96414-6de2-416b-b0ed-b3ab05733653 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1724 microversion: 2.20 time: 0.229775 Sep 04 16:21:48.172757 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 514/1030] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:21:47 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:21:49.188112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-5357d288-f1ef-41e1-9963-2b6db322c543 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:49.188727 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-5357d288-f1ef-41e1-9963-2b6db322c543 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:49.195287 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5357d288-f1ef-41e1-9963-2b6db322c543 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:49.195772 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5357d288-f1ef-41e1-9963-2b6db322c543 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:49.196209 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5357d288-f1ef-41e1-9963-2b6db322c543 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:49.197010 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5357d288-f1ef-41e1-9963-2b6db322c543 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:49.197481 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5357d288-f1ef-41e1-9963-2b6db322c543 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:49.197879 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-00c2e700-90c9-426e-a64b-24c2d9e4c831 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:49.198331 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-5357d288-f1ef-41e1-9963-2b6db322c543 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:49.198475 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-00c2e700-90c9-426e-a64b-24c2d9e4c831 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:49.205255 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-00c2e700-90c9-426e-a64b-24c2d9e4c831 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:49.205798 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-00c2e700-90c9-426e-a64b-24c2d9e4c831 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:49.206231 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-00c2e700-90c9-426e-a64b-24c2d9e4c831 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:49.206920 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-00c2e700-90c9-426e-a64b-24c2d9e4c831 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:49.207378 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-00c2e700-90c9-426e-a64b-24c2d9e4c831 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:49.207800 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-00c2e700-90c9-426e-a64b-24c2d9e4c831 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:49.467408 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-5357d288-f1ef-41e1-9963-2b6db322c543 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:49.473839 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-00c2e700-90c9-426e-a64b-24c2d9e4c831 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:49.482679 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-5357d288-f1ef-41e1-9963-2b6db322c543 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4" status: 200 len: 1681 microversion: 2.1 time: 0.299272 Sep 04 16:21:49.483472 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 517/1031] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:21:49 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 => generated 1681 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:21:49.483680 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-00c2e700-90c9-426e-a64b-24c2d9e4c831 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:49.487349 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-00c2e700-90c9-426e-a64b-24c2d9e4c831 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:49.491008 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-00c2e700-90c9-426e-a64b-24c2d9e4c831 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1724 microversion: 2.20 time: 0.294882 Sep 04 16:21:49.491008 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 515/1032] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:21:49 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:21:50.506976 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b34036c0-5b38-4fc4-bcec-c21f4f35bd7b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:50.507577 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b34036c0-5b38-4fc4-bcec-c21f4f35bd7b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:50.514257 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b34036c0-5b38-4fc4-bcec-c21f4f35bd7b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:50.514738 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b34036c0-5b38-4fc4-bcec-c21f4f35bd7b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:50.515165 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b34036c0-5b38-4fc4-bcec-c21f4f35bd7b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:50.515855 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b34036c0-5b38-4fc4-bcec-c21f4f35bd7b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:50.516300 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b34036c0-5b38-4fc4-bcec-c21f4f35bd7b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:50.516713 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b34036c0-5b38-4fc4-bcec-c21f4f35bd7b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:50.519214 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7c816c47-5bd5-47a6-9fad-924498374ef2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:50.520546 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7c816c47-5bd5-47a6-9fad-924498374ef2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:50.528958 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7c816c47-5bd5-47a6-9fad-924498374ef2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:50.529737 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7c816c47-5bd5-47a6-9fad-924498374ef2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:50.530232 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7c816c47-5bd5-47a6-9fad-924498374ef2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:50.531026 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7c816c47-5bd5-47a6-9fad-924498374ef2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:50.531544 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7c816c47-5bd5-47a6-9fad-924498374ef2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:50.532031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7c816c47-5bd5-47a6-9fad-924498374ef2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:50.626611 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b34036c0-5b38-4fc4-bcec-c21f4f35bd7b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:50.630722 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7c816c47-5bd5-47a6-9fad-924498374ef2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:50.634336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b34036c0-5b38-4fc4-bcec-c21f4f35bd7b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4" status: 200 len: 1613 microversion: 2.1 time: 0.131353 Sep 04 16:21:50.635127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 518/1033] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:21:50 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 => generated 1613 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:21:50.652497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7c816c47-5bd5-47a6-9fad-924498374ef2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:50.655207 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7c816c47-5bd5-47a6-9fad-924498374ef2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:50.656436 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7c816c47-5bd5-47a6-9fad-924498374ef2 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1656 microversion: 2.20 time: 0.141688 Sep 04 16:21:50.657130 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 516/1034] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:21:50 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1656 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 04 16:21:50.942505 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-ce516325-f6ce-421e-be72-e51ba0d6d583 req-b6664eee-ad4a-472e-87b9-4d05567cfc87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca19c96e-1c3a-4bb3-875a-a16eb18f59b4", "name": "network-vif-deleted", "tag": "9501fe5b-4b6e-4acf-abe4-45f64425a768"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:21:50.959570 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ce516325-f6ce-421e-be72-e51ba0d6d583 req-b6664eee-ad4a-472e-87b9-4d05567cfc87 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:50.960267 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ce516325-f6ce-421e-be72-e51ba0d6d583 req-b6664eee-ad4a-472e-87b9-4d05567cfc87 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:50.960882 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ce516325-f6ce-421e-be72-e51ba0d6d583 req-b6664eee-ad4a-472e-87b9-4d05567cfc87 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:50.994173 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-ce516325-f6ce-421e-be72-e51ba0d6d583 req-b6664eee-ad4a-472e-87b9-4d05567cfc87 service nova] Creating event network-vif-deleted:9501fe5b-4b6e-4acf-abe4-45f64425a768 for instance ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 on hv-cinder-85236 Sep 04 16:21:50.995812 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-ce516325-f6ce-421e-be72-e51ba0d6d583 req-b6664eee-ad4a-472e-87b9-4d05567cfc87 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056656 Sep 04 16:21:50.998965 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 519/1035] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:21:51.664279 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f92856eb-c2e7-4c8c-8ed8-8a5f79d05575 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:51.665656 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f92856eb-c2e7-4c8c-8ed8-8a5f79d05575 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:51.675009 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f92856eb-c2e7-4c8c-8ed8-8a5f79d05575 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:51.675494 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f92856eb-c2e7-4c8c-8ed8-8a5f79d05575 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:51.675925 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f92856eb-c2e7-4c8c-8ed8-8a5f79d05575 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:51.685655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0c491ffb-60c8-42d3-a157-7b83233a22d4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:51.687813 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0c491ffb-60c8-42d3-a157-7b83233a22d4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:51.693685 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f92856eb-c2e7-4c8c-8ed8-8a5f79d05575 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:51.694498 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f92856eb-c2e7-4c8c-8ed8-8a5f79d05575 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:51.696050 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f92856eb-c2e7-4c8c-8ed8-8a5f79d05575 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:51.701484 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c491ffb-60c8-42d3-a157-7b83233a22d4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:51.702231 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c491ffb-60c8-42d3-a157-7b83233a22d4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:51.702657 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c491ffb-60c8-42d3-a157-7b83233a22d4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:51.711820 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c491ffb-60c8-42d3-a157-7b83233a22d4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:51.712457 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c491ffb-60c8-42d3-a157-7b83233a22d4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:51.717916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c491ffb-60c8-42d3-a157-7b83233a22d4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:51.753887 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c491ffb-60c8-42d3-a157-7b83233a22d4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:51.754677 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c491ffb-60c8-42d3-a157-7b83233a22d4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:51.755472 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-0c491ffb-60c8-42d3-a157-7b83233a22d4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:51.756112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-0c491ffb-60c8-42d3-a157-7b83233a22d4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lazy-loading 'fault' on Instance uuid ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:21:51.767617 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f92856eb-c2e7-4c8c-8ed8-8a5f79d05575 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:51.768111 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f92856eb-c2e7-4c8c-8ed8-8a5f79d05575 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:51.768551 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f92856eb-c2e7-4c8c-8ed8-8a5f79d05575 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:51.769008 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-f92856eb-c2e7-4c8c-8ed8-8a5f79d05575 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lazy-loading 'fault' on Instance uuid ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:21:51.821071 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0c491ffb-60c8-42d3-a157-7b83233a22d4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:51.841358 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0c491ffb-60c8-42d3-a157-7b83233a22d4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:51.843942 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0c491ffb-60c8-42d3-a157-7b83233a22d4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1623e93ad6844cacae7cc1a71b339f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3219dc7400ec4957a31b1b0fabfd8c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:51.849604 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0c491ffb-60c8-42d3-a157-7b83233a22d4 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 200 len: 1372 microversion: 2.20 time: 0.171251 Sep 04 16:21:51.852258 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 520/1036] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:21:51 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 04 16:21:51.868527 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f92856eb-c2e7-4c8c-8ed8-8a5f79d05575 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e5c22b631df4600b9f920120b67fc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc5ea4158344d5c8a35bc5783410620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:21:51.877615 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f92856eb-c2e7-4c8c-8ed8-8a5f79d05575 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4" status: 200 len: 1330 microversion: 2.1 time: 0.222424 Sep 04 16:21:51.878929 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 517/1037] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:21:51 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 => generated 1330 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:21:52.875094 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-02f40e06-fbbe-420d-a585-f648c7dbec53 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:52.875712 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-02f40e06-fbbe-420d-a585-f648c7dbec53 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:52.882873 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02f40e06-fbbe-420d-a585-f648c7dbec53 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:52.883348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02f40e06-fbbe-420d-a585-f648c7dbec53 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:52.883773 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02f40e06-fbbe-420d-a585-f648c7dbec53 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:52.884449 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02f40e06-fbbe-420d-a585-f648c7dbec53 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:52.884897 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02f40e06-fbbe-420d-a585-f648c7dbec53 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:52.885310 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02f40e06-fbbe-420d-a585-f648c7dbec53 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:52.898645 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-02f40e06-fbbe-420d-a585-f648c7dbec53 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] HTTP exception thrown: Instance ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 could not be found. Sep 04 16:21:52.900572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-02f40e06-fbbe-420d-a585-f648c7dbec53 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Request method failure captured: Sep 04 16:21:52.900572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 HTTP/1.1 Sep 04 16:21:52.900572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:21:52.900572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:21:52.900572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:21:52.900572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 04 16:21:52.900572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:21:52.900572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:21:52.900572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:21:52.900572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:21:52.900572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFM66LdGBrKyEum4ImUpWqHnqyUTcOx-vYn5pH9Y6tWuUdEMtMHv_I1VFXcYlu9ggjltB-RbCpbzQMSJocPpbFiPZrd4_bOcYduI4ERdpxKwKkyGxzdKLmffAh5gijW50OZlJxNLfn2JQADs0eoXShr3D6U9xPmGe0Esx4KTSy4mZjXA Sep 04 16:21:52.900572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:21:52.900572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:21:52.900572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:21:52.900572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:21:52.900572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Openstack-Nova-Api-Version: 2.20 Sep 04 16:21:52.900572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:21:52.900572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:21:52.900572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: 3219dc7400ec4957a31b1b0fabfd8c56 Sep 04 16:21:52.900572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-243620880 Sep 04 16:21:52.900572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:21:52.900572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:21:52.902369 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3219dc7400ec4957a31b1b0fabfd8c56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3219dc7400ec4957a31b1b0fabfd8c56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3219dc7400ec4957a31b1b0fabfd8c56", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3219dc7400ec4957a31b1b0fabfd8c56"}]}] Sep 04 16:21:52.902369 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeShelveTestJSON-243620880 Sep 04 16:21:52.902369 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: 3219dc7400ec4957a31b1b0fabfd8c56 Sep 04 16:21:52.902369 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-243620880 Sep 04 16:21:52.902369 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-AttachVolumeShelveTestJSON-243620880-project Sep 04 16:21:52.902369 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:21:52.902369 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:21:52.902369 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: 1623e93ad6844cacae7cc1a71b339f22 Sep 04 16:21:52.902369 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeShelveTestJSON-243620880-project Sep 04 16:21:52.902369 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: > Sep 04 16:21:52.902369 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Instance ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 could not be found. Sep 04 16:21:52.902369 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'id': 'ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73'} Sep 04 16:21:52.903254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:21:52.903254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:52.903254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:21:52.903254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:21:52.903254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:21:52.903254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:21:52.903254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:21:52.903254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:21:52.903254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:21:52.903254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:21:52.903254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 could not be found. Sep 04 16:21:52.903254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:52.903254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:52.903254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:52.903254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:52.903254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:52.903254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:52.903254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:21:52.903254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:21:52.903254 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:21:52.904544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:21:52.904544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:21:52.904544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:21:52.904544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:21:52.904544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:21:52.904544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:21:52.904544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:21:52.904544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 could not be found. Sep 04 16:21:52.904544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:52.904544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:52.904544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:52.904544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:52.904544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:52.904544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:52.904544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:21:52.904544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:21:52.904544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 could not be found. Sep 04 16:21:52.904544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:52.905750 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-02f40e06-fbbe-420d-a585-f648c7dbec53 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Returning 404 to user: Instance ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:21:52.905832 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-99229d58-ec39-4463-b1c7-94aad6fb2fce tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:52.906641 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-02f40e06-fbbe-420d-a585-f648c7dbec53 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 404 len: 111 microversion: 2.20 time: 0.030788 Sep 04 16:21:52.906753 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-99229d58-ec39-4463-b1c7-94aad6fb2fce tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:52.906848 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 521/1038] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:21:52 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 04 16:21:52.909466 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99229d58-ec39-4463-b1c7-94aad6fb2fce tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:52.909983 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99229d58-ec39-4463-b1c7-94aad6fb2fce tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:52.910420 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99229d58-ec39-4463-b1c7-94aad6fb2fce tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:52.910733 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-92da3039-142a-4cfa-8a20-cb0dfbb9a36f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '.version_select at 0x7f96890edee0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:52.911117 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99229d58-ec39-4463-b1c7-94aad6fb2fce tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:52.911596 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99229d58-ec39-4463-b1c7-94aad6fb2fce tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:52.912018 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99229d58-ec39-4463-b1c7-94aad6fb2fce tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:52.926145 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-99229d58-ec39-4463-b1c7-94aad6fb2fce tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] HTTP exception thrown: Instance ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 could not be found. Sep 04 16:21:52.927814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-99229d58-ec39-4463-b1c7-94aad6fb2fce tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Request method failure captured: Sep 04 16:21:52.927814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 HTTP/1.1 Sep 04 16:21:52.927814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:21:52.927814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:21:52.927814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:21:52.927814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:21:52.927814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:21:52.927814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:21:52.927814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:21:52.927814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:21:52.927814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFM7CEjNpb-xR3hPJMPQ-wsTXSagT7BYEktfOgtljHhzvAeE20V1mpt42r1aF9sMAbjmPPVeaP94mwlrfyovEVPw6ArC_YpgCrCSBFtvcpj7IAtQcwG53eIdKr17VLDw7eStXYQicK9SnKgixnRa-ofn7JvVLgTmHvsJ-_KcGiq48xm4 Sep 04 16:21:52.927814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:21:52.927814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:21:52.927814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:21:52.927814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:21:52.927814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:21:52.927814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:21:52.927814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:21:52.927814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:52.927814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:21:52.927814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:21:52.929622 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1cc5ea4158344d5c8a35bc5783410620", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}] Sep 04 16:21:52.929622 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:52.929622 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:21:52.929622 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:52.929622 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:21:52.929622 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:21:52.929622 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:21:52.929622 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: 6e5c22b631df4600b9f920120b67fc67 Sep 04 16:21:52.929622 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:21:52.929622 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: > Sep 04 16:21:52.929622 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Instance ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 could not be found. Sep 04 16:21:52.929622 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': 'ca19c96e-1c3a-4bb3-875a-a16eb18f59b4'} Sep 04 16:21:52.930628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:21:52.930628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:52.930628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:21:52.930628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:21:52.930628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:21:52.930628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:21:52.930628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:21:52.930628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:21:52.930628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:21:52.930628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:21:52.930628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 could not be found. Sep 04 16:21:52.930628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:52.930628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:52.930628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:52.930628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:52.930628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:52.930628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:52.930628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:21:52.930628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:21:52.930628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:21:52.932227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:21:52.932227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:21:52.932227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:21:52.932227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:21:52.932227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:21:52.932227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:21:52.932227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:21:52.932227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 could not be found. Sep 04 16:21:52.932227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:52.932227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:52.932227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:52.932227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:52.932227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:52.932227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:52.932227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:21:52.932227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:21:52.932227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 could not be found. Sep 04 16:21:52.932227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:52.933608 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-99229d58-ec39-4463-b1c7-94aad6fb2fce tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Returning 404 to user: Instance ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:21:52.933608 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-99229d58-ec39-4463-b1c7-94aad6fb2fce tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4" status: 404 len: 111 microversion: 2.1 time: 0.031636 Sep 04 16:21:52.933608 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 518/1039] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:21:52 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 04 16:21:52.938474 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3a66ae80-b0e8-4789-949f-6d042ac7ba8b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '.version_select at 0x7f968904d820>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:52.978869 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-92da3039-142a-4cfa-8a20-cb0dfbb9a36f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1423648917" status: 204 len: 0 microversion: 2.20 time: 0.071609 Sep 04 16:21:52.979448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 522/1040] 10.222.0.39 () {60 vars in 1262 bytes} [Sun Sep 4 16:21:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1423648917 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 04 16:21:53.024726 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-b2d50ed3-d5ca-4f6e-a42f-bce41e2151cf req-eac9ac20-29bd-4ff9-8851-b222470c5498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73", "name": "network-vif-deleted", "tag": "6d210ca9-1ff4-4f3e-842e-652e252e69a7"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:21:53.030619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3a66ae80-b0e8-4789-949f-6d042ac7ba8b tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-234402332" status: 202 len: 0 microversion: 2.1 time: 0.096318 Sep 04 16:21:53.031938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 519/1041] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Sep 4 16:21:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-234402332 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 04 16:21:53.037077 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b2d50ed3-d5ca-4f6e-a42f-bce41e2151cf req-eac9ac20-29bd-4ff9-8851-b222470c5498 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:53.037552 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b2d50ed3-d5ca-4f6e-a42f-bce41e2151cf req-eac9ac20-29bd-4ff9-8851-b222470c5498 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:53.038004 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-b2d50ed3-d5ca-4f6e-a42f-bce41e2151cf req-eac9ac20-29bd-4ff9-8851-b222470c5498 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:53.049671 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-b2d50ed3-d5ca-4f6e-a42f-bce41e2151cf req-eac9ac20-29bd-4ff9-8851-b222470c5498 service nova] Creating event network-vif-deleted:6d210ca9-1ff4-4f3e-842e-652e252e69a7 for instance ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 on hv-cinder-85236 Sep 04 16:21:53.054424 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-b2d50ed3-d5ca-4f6e-a42f-bce41e2151cf req-eac9ac20-29bd-4ff9-8851-b222470c5498 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033427 Sep 04 16:21:53.054998 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 523/1042] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:21:55.494737 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e7e08271-801a-429d-8c9d-beb1fa0c6a98 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:55.495252 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e7e08271-801a-429d-8c9d-beb1fa0c6a98 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:55.502913 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e7e08271-801a-429d-8c9d-beb1fa0c6a98 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:55.503435 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e7e08271-801a-429d-8c9d-beb1fa0c6a98 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:55.503924 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e7e08271-801a-429d-8c9d-beb1fa0c6a98 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:55.504632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e7e08271-801a-429d-8c9d-beb1fa0c6a98 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:55.505092 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e7e08271-801a-429d-8c9d-beb1fa0c6a98 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:55.505520 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e7e08271-801a-429d-8c9d-beb1fa0c6a98 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:55.519871 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-e7e08271-801a-429d-8c9d-beb1fa0c6a98 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] HTTP exception thrown: Instance ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 could not be found. Sep 04 16:21:55.521427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e7e08271-801a-429d-8c9d-beb1fa0c6a98 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Request method failure captured: Sep 04 16:21:55.521427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: DELETE /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 HTTP/1.1 Sep 04 16:21:55.521427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:21:55.521427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:21:55.521427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:21:55.521427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:21:55.521427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:21:55.521427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:21:55.521427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:21:55.521427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:21:55.521427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFM7CEjNpb-xR3hPJMPQ-wsTXSagT7BYEktfOgtljHhzvAeE20V1mpt42r1aF9sMAbjmPPVeaP94mwlrfyovEVPw6ArC_YpgCrCSBFtvcpj7IAtQcwG53eIdKr17VLDw7eStXYQicK9SnKgixnRa-ofn7JvVLgTmHvsJ-_KcGiq48xm4 Sep 04 16:21:55.521427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:21:55.521427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:21:55.521427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:21:55.521427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:21:55.521427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:21:55.521427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:21:55.521427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:21:55.521427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:55.521427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:21:55.521427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:21:55.523086 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1cc5ea4158344d5c8a35bc5783410620", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}] Sep 04 16:21:55.523086 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:55.523086 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:21:55.523086 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:55.523086 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:21:55.523086 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:21:55.523086 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:21:55.523086 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: 6e5c22b631df4600b9f920120b67fc67 Sep 04 16:21:55.523086 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:21:55.523086 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: > Sep 04 16:21:55.523086 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Instance ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 could not be found. Sep 04 16:21:55.523086 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': 'ca19c96e-1c3a-4bb3-875a-a16eb18f59b4'} Sep 04 16:21:55.526619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:21:55.526619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:55.526619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:21:55.526619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:21:55.526619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:21:55.526619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:21:55.526619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:21:55.526619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:21:55.526619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:21:55.526619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:21:55.526619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 could not be found. Sep 04 16:21:55.526619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:55.526619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:55.526619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:55.526619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:55.526619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:55.526619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:55.526619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:21:55.526619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:21:55.526619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:21:55.527922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:21:55.527922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 04 16:21:55.527922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 04 16:21:55.527922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 04 16:21:55.527922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 04 16:21:55.527922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:21:55.527922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:21:55.527922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:21:55.527922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:21:55.527922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 could not be found. Sep 04 16:21:55.527922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:55.527922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:55.527922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:55.527922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:55.527922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:55.527922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:55.527922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:21:55.527922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:21:55.527922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 could not be found. Sep 04 16:21:55.527922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:55.529287 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cee84cc0-ce7d-4726-a58f-3a8212bdafd5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:55.529936 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e7e08271-801a-429d-8c9d-beb1fa0c6a98 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Returning 404 to user: Instance ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:21:55.530036 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cee84cc0-ce7d-4726-a58f-3a8212bdafd5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:55.530128 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e7e08271-801a-429d-8c9d-beb1fa0c6a98 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4" status: 404 len: 111 microversion: 2.1 time: 0.032685 Sep 04 16:21:55.530128 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 520/1043] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:21:55 2022] DELETE /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:21:55.530307 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cee84cc0-ce7d-4726-a58f-3a8212bdafd5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:55.530307 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cee84cc0-ce7d-4726-a58f-3a8212bdafd5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:55.530307 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cee84cc0-ce7d-4726-a58f-3a8212bdafd5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:55.530567 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cee84cc0-ce7d-4726-a58f-3a8212bdafd5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:55.530919 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cee84cc0-ce7d-4726-a58f-3a8212bdafd5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:55.531336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cee84cc0-ce7d-4726-a58f-3a8212bdafd5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:55.531956 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6190c008-107f-4f51-bd23-f8a367cdafc6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:55.532676 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-6190c008-107f-4f51-bd23-f8a367cdafc6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: ca19c96e-1c3a-4bb3-875a-a16eb18f59b4] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:55.538770 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6190c008-107f-4f51-bd23-f8a367cdafc6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:55.539252 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6190c008-107f-4f51-bd23-f8a367cdafc6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:55.539688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6190c008-107f-4f51-bd23-f8a367cdafc6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:55.540387 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6190c008-107f-4f51-bd23-f8a367cdafc6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:55.540843 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6190c008-107f-4f51-bd23-f8a367cdafc6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:55.541269 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-6190c008-107f-4f51-bd23-f8a367cdafc6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:55.544651 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-cee84cc0-ce7d-4726-a58f-3a8212bdafd5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] HTTP exception thrown: Instance ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 could not be found. Sep 04 16:21:55.546443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cee84cc0-ce7d-4726-a58f-3a8212bdafd5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Request method failure captured: Sep 04 16:21:55.546443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 HTTP/1.1 Sep 04 16:21:55.546443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:21:55.546443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:21:55.546443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:21:55.546443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 04 16:21:55.546443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:21:55.546443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:21:55.546443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:21:55.546443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:21:55.546443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFM66LdGBrKyEum4ImUpWqHnqyUTcOx-vYn5pH9Y6tWuUdEMtMHv_I1VFXcYlu9ggjltB-RbCpbzQMSJocPpbFiPZrd4_bOcYduI4ERdpxKwKkyGxzdKLmffAh5gijW50OZlJxNLfn2JQADs0eoXShr3D6U9xPmGe0Esx4KTSy4mZjXA Sep 04 16:21:55.546443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:21:55.546443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:21:55.546443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:21:55.546443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:21:55.546443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Openstack-Nova-Api-Version: 2.20 Sep 04 16:21:55.546443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:21:55.546443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:21:55.546443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: 3219dc7400ec4957a31b1b0fabfd8c56 Sep 04 16:21:55.546443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-243620880 Sep 04 16:21:55.546443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:21:55.546443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:21:55.548152 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3219dc7400ec4957a31b1b0fabfd8c56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3219dc7400ec4957a31b1b0fabfd8c56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3219dc7400ec4957a31b1b0fabfd8c56", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3219dc7400ec4957a31b1b0fabfd8c56"}]}] Sep 04 16:21:55.548152 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeShelveTestJSON-243620880 Sep 04 16:21:55.548152 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: 3219dc7400ec4957a31b1b0fabfd8c56 Sep 04 16:21:55.548152 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-243620880 Sep 04 16:21:55.548152 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-AttachVolumeShelveTestJSON-243620880-project Sep 04 16:21:55.548152 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:21:55.548152 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:21:55.548152 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: 1623e93ad6844cacae7cc1a71b339f22 Sep 04 16:21:55.548152 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeShelveTestJSON-243620880-project Sep 04 16:21:55.548152 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: > Sep 04 16:21:55.548152 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Instance ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 could not be found. Sep 04 16:21:55.548152 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'id': 'ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73'} Sep 04 16:21:55.548916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:21:55.548916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:55.548916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:21:55.548916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:21:55.548916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:21:55.548916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:21:55.548916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:21:55.548916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:21:55.548916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:21:55.548916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:21:55.548916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 could not be found. Sep 04 16:21:55.548916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:55.548916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:55.548916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:55.548916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:55.548916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:55.548916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:55.548916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:21:55.548916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:21:55.548916 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:21:55.550177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:21:55.550177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 04 16:21:55.550177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 04 16:21:55.550177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 04 16:21:55.550177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 04 16:21:55.550177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:21:55.550177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:21:55.550177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:21:55.550177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:21:55.550177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 could not be found. Sep 04 16:21:55.550177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:55.550177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:55.550177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:55.550177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:55.550177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:55.550177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:55.550177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:21:55.550177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:21:55.550177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 could not be found. Sep 04 16:21:55.550177 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:55.551445 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cee84cc0-ce7d-4726-a58f-3a8212bdafd5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Returning 404 to user: Instance ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:21:55.551445 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cee84cc0-ce7d-4726-a58f-3a8212bdafd5 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 404 len: 111 microversion: 2.20 time: 0.030772 Sep 04 16:21:55.551445 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 524/1044] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Sep 4 16:21:55 2022] DELETE /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 04 16:21:55.554657 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-6190c008-107f-4f51-bd23-f8a367cdafc6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] HTTP exception thrown: Instance ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 could not be found. Sep 04 16:21:55.556113 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-03f222ac-118b-43fa-98df-46875c543230 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:55.556241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6190c008-107f-4f51-bd23-f8a367cdafc6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Request method failure captured: Sep 04 16:21:55.556241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 HTTP/1.1 Sep 04 16:21:55.556241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:21:55.556241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:21:55.556241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:21:55.556241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:21:55.556241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:21:55.556241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:21:55.556241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:21:55.556241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:21:55.556241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFM7CEjNpb-xR3hPJMPQ-wsTXSagT7BYEktfOgtljHhzvAeE20V1mpt42r1aF9sMAbjmPPVeaP94mwlrfyovEVPw6ArC_YpgCrCSBFtvcpj7IAtQcwG53eIdKr17VLDw7eStXYQicK9SnKgixnRa-ofn7JvVLgTmHvsJ-_KcGiq48xm4 Sep 04 16:21:55.556241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:21:55.556241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:21:55.556241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:21:55.556241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:21:55.556241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:21:55.556241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:21:55.556241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:21:55.556241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:55.556241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:21:55.556241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:21:55.557775 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1cc5ea4158344d5c8a35bc5783410620", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}] Sep 04 16:21:55.557775 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:55.557775 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:21:55.557775 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:55.557775 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:21:55.557775 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:21:55.557775 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:21:55.557775 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: 6e5c22b631df4600b9f920120b67fc67 Sep 04 16:21:55.557775 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:21:55.557775 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: > Sep 04 16:21:55.557775 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Instance ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 could not be found. Sep 04 16:21:55.557775 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': 'ca19c96e-1c3a-4bb3-875a-a16eb18f59b4'} Sep 04 16:21:55.558869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:21:55.558869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:55.558869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:21:55.558869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:21:55.558869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:21:55.558869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:21:55.558869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:21:55.558869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:21:55.558869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:21:55.558869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:21:55.558869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 could not be found. Sep 04 16:21:55.558869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:55.558869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:55.558869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:55.558869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:55.558869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:55.558869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:55.558869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:21:55.558869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:21:55.558869 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:21:55.560234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:21:55.560234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:21:55.560234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:21:55.560234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:21:55.560234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:21:55.560234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:21:55.560234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:21:55.560234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 could not be found. Sep 04 16:21:55.560234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:55.560234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:55.560234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:55.560234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:55.560234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:55.560234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:55.560234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:21:55.560234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:21:55.560234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 could not be found. Sep 04 16:21:55.560234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:55.562620 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-6190c008-107f-4f51-bd23-f8a367cdafc6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Returning 404 to user: Instance ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:21:55.562761 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-03f222ac-118b-43fa-98df-46875c543230 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:55.562914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-6190c008-107f-4f51-bd23-f8a367cdafc6 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4" status: 404 len: 111 microversion: 2.1 time: 0.029785 Sep 04 16:21:55.562914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 521/1045] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:21:55 2022] GET /compute/v2.1/servers/ca19c96e-1c3a-4bb3-875a-a16eb18f59b4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 04 16:21:55.563911 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03f222ac-118b-43fa-98df-46875c543230 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:55.564511 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03f222ac-118b-43fa-98df-46875c543230 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:55.564947 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03f222ac-118b-43fa-98df-46875c543230 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:55.565667 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03f222ac-118b-43fa-98df-46875c543230 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:55.566114 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03f222ac-118b-43fa-98df-46875c543230 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:55.566528 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03f222ac-118b-43fa-98df-46875c543230 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:55.580869 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-03f222ac-118b-43fa-98df-46875c543230 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] HTTP exception thrown: Instance ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 could not be found. Sep 04 16:21:55.582443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-03f222ac-118b-43fa-98df-46875c543230 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Request method failure captured: Sep 04 16:21:55.582443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 HTTP/1.1 Sep 04 16:21:55.582443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:21:55.582443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:21:55.582443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:21:55.582443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 04 16:21:55.582443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:21:55.582443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:21:55.582443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:21:55.582443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:21:55.582443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFM66LdGBrKyEum4ImUpWqHnqyUTcOx-vYn5pH9Y6tWuUdEMtMHv_I1VFXcYlu9ggjltB-RbCpbzQMSJocPpbFiPZrd4_bOcYduI4ERdpxKwKkyGxzdKLmffAh5gijW50OZlJxNLfn2JQADs0eoXShr3D6U9xPmGe0Esx4KTSy4mZjXA Sep 04 16:21:55.582443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:21:55.582443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:21:55.582443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:21:55.582443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:21:55.582443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Openstack-Nova-Api-Version: 2.20 Sep 04 16:21:55.582443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:21:55.582443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:21:55.582443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: 3219dc7400ec4957a31b1b0fabfd8c56 Sep 04 16:21:55.582443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-243620880 Sep 04 16:21:55.582443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:21:55.582443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:21:55.584801 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3219dc7400ec4957a31b1b0fabfd8c56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3219dc7400ec4957a31b1b0fabfd8c56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3219dc7400ec4957a31b1b0fabfd8c56", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3219dc7400ec4957a31b1b0fabfd8c56"}]}] Sep 04 16:21:55.584801 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeShelveTestJSON-243620880 Sep 04 16:21:55.584801 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: 3219dc7400ec4957a31b1b0fabfd8c56 Sep 04 16:21:55.584801 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-243620880 Sep 04 16:21:55.584801 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-AttachVolumeShelveTestJSON-243620880-project Sep 04 16:21:55.584801 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:21:55.584801 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:21:55.584801 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: 1623e93ad6844cacae7cc1a71b339f22 Sep 04 16:21:55.584801 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeShelveTestJSON-243620880-project Sep 04 16:21:55.584801 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: > Sep 04 16:21:55.584801 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Instance ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 could not be found. Sep 04 16:21:55.584801 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'id': 'ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73'} Sep 04 16:21:55.586069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:21:55.586069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:55.586069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:21:55.586069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:21:55.586069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:21:55.586069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:21:55.586069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:21:55.586069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:21:55.586069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:21:55.586069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:21:55.586069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 could not be found. Sep 04 16:21:55.586069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:55.586069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:55.586069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:55.586069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:55.586069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:55.586069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:55.586069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:21:55.586069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:21:55.586069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:21:55.587678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:21:55.587678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:21:55.587678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:21:55.587678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:21:55.587678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:21:55.587678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:21:55.587678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:21:55.587678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 could not be found. Sep 04 16:21:55.587678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:55.587678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:55.587678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:55.587678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:55.587678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:55.587678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:55.587678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:21:55.587678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:21:55.587678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 could not be found. Sep 04 16:21:55.587678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:55.589049 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-03f222ac-118b-43fa-98df-46875c543230 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Returning 404 to user: Instance ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:21:55.589049 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-03f222ac-118b-43fa-98df-46875c543230 tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73" status: 404 len: 111 microversion: 2.20 time: 0.031266 Sep 04 16:21:55.589049 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 525/1046] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:21:55 2022] GET /compute/v2.1/servers/ee6b3bc1-6f8f-4b3d-bc64-1a1fc4b4ee73 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 04 16:21:56.851955 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2303d4b7-99b3-4cb5-a6f5-4a69e0107b29 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:56.852444 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2303d4b7-99b3-4cb5-a6f5-4a69e0107b29 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:56.858992 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2303d4b7-99b3-4cb5-a6f5-4a69e0107b29 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:56.859469 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2303d4b7-99b3-4cb5-a6f5-4a69e0107b29 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:56.859895 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2303d4b7-99b3-4cb5-a6f5-4a69e0107b29 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:56.860575 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2303d4b7-99b3-4cb5-a6f5-4a69e0107b29 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:56.861019 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2303d4b7-99b3-4cb5-a6f5-4a69e0107b29 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:56.861436 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2303d4b7-99b3-4cb5-a6f5-4a69e0107b29 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:56.875173 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-2303d4b7-99b3-4cb5-a6f5-4a69e0107b29 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] HTTP exception thrown: Instance 9e5636f2-5f2f-45ca-af8a-d998079502df could not be found. Sep 04 16:21:56.876719 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2303d4b7-99b3-4cb5-a6f5-4a69e0107b29 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Request method failure captured: Sep 04 16:21:56.876719 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: DELETE /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df HTTP/1.1 Sep 04 16:21:56.876719 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:21:56.876719 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:21:56.876719 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:21:56.876719 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:21:56.876719 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:21:56.876719 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:21:56.876719 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:21:56.876719 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:21:56.876719 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFM7CEjNpb-xR3hPJMPQ-wsTXSagT7BYEktfOgtljHhzvAeE20V1mpt42r1aF9sMAbjmPPVeaP94mwlrfyovEVPw6ArC_YpgCrCSBFtvcpj7IAtQcwG53eIdKr17VLDw7eStXYQicK9SnKgixnRa-ofn7JvVLgTmHvsJ-_KcGiq48xm4 Sep 04 16:21:56.876719 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:21:56.876719 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:21:56.876719 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:21:56.876719 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:21:56.876719 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:21:56.876719 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:21:56.876719 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:21:56.876719 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:56.876719 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:21:56.876719 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:21:56.878341 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1cc5ea4158344d5c8a35bc5783410620", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}] Sep 04 16:21:56.878341 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:56.878341 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:21:56.878341 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:56.878341 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:21:56.878341 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:21:56.878341 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:21:56.878341 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: 6e5c22b631df4600b9f920120b67fc67 Sep 04 16:21:56.878341 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:21:56.878341 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: > Sep 04 16:21:56.878341 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Instance 9e5636f2-5f2f-45ca-af8a-d998079502df could not be found. Sep 04 16:21:56.878341 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': '9e5636f2-5f2f-45ca-af8a-d998079502df'} Sep 04 16:21:56.882059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:21:56.882059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:56.882059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:21:56.882059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:21:56.882059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:21:56.882059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:21:56.882059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:21:56.882059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:21:56.882059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:21:56.882059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:21:56.882059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e5636f2-5f2f-45ca-af8a-d998079502df could not be found. Sep 04 16:21:56.882059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.882059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:56.882059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.882059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:56.882059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:56.882059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:56.882059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:21:56.882059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:21:56.882059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:21:56.883542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:21:56.883542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 04 16:21:56.883542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 04 16:21:56.883542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 04 16:21:56.883542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 04 16:21:56.883542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:21:56.883542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:21:56.883542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:21:56.883542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:21:56.883542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e5636f2-5f2f-45ca-af8a-d998079502df could not be found. Sep 04 16:21:56.883542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.883542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:56.883542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.883542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:56.883542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:56.883542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:56.883542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:21:56.883542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:21:56.883542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e5636f2-5f2f-45ca-af8a-d998079502df could not be found. Sep 04 16:21:56.883542 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.885110 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2303d4b7-99b3-4cb5-a6f5-4a69e0107b29 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Returning 404 to user: Instance 9e5636f2-5f2f-45ca-af8a-d998079502df could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:21:56.885110 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2303d4b7-99b3-4cb5-a6f5-4a69e0107b29 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 404 len: 111 microversion: 2.1 time: 0.030022 Sep 04 16:21:56.885110 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 522/1047] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:21:56 2022] DELETE /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:21:56.885365 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b1355733-4aef-4357-b3d9-f395e9149b9f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:56.885365 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b1355733-4aef-4357-b3d9-f395e9149b9f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:56.887557 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5ad4ad8b-e8cc-429a-8a06-13952571d0e7 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:56.888205 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5ad4ad8b-e8cc-429a-8a06-13952571d0e7 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 9e5636f2-5f2f-45ca-af8a-d998079502df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:56.891440 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1355733-4aef-4357-b3d9-f395e9149b9f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:56.892586 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1355733-4aef-4357-b3d9-f395e9149b9f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:56.893362 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1355733-4aef-4357-b3d9-f395e9149b9f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:56.894440 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1355733-4aef-4357-b3d9-f395e9149b9f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:56.894899 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1355733-4aef-4357-b3d9-f395e9149b9f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:56.895415 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b1355733-4aef-4357-b3d9-f395e9149b9f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:56.897057 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ad4ad8b-e8cc-429a-8a06-13952571d0e7 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:56.897556 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ad4ad8b-e8cc-429a-8a06-13952571d0e7 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:56.900165 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ad4ad8b-e8cc-429a-8a06-13952571d0e7 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:56.901155 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ad4ad8b-e8cc-429a-8a06-13952571d0e7 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:56.901642 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ad4ad8b-e8cc-429a-8a06-13952571d0e7 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:56.902078 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5ad4ad8b-e8cc-429a-8a06-13952571d0e7 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:56.914402 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-b1355733-4aef-4357-b3d9-f395e9149b9f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] HTTP exception thrown: Instance 25192300-f22a-4b50-b390-17236f961eb5 could not be found. Sep 04 16:21:56.915950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b1355733-4aef-4357-b3d9-f395e9149b9f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Request method failure captured: Sep 04 16:21:56.915950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 HTTP/1.1 Sep 04 16:21:56.915950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:21:56.915950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:21:56.915950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:21:56.915950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 04 16:21:56.915950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:21:56.915950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:21:56.915950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:21:56.915950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:21:56.915950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFM66LdGBrKyEum4ImUpWqHnqyUTcOx-vYn5pH9Y6tWuUdEMtMHv_I1VFXcYlu9ggjltB-RbCpbzQMSJocPpbFiPZrd4_bOcYduI4ERdpxKwKkyGxzdKLmffAh5gijW50OZlJxNLfn2JQADs0eoXShr3D6U9xPmGe0Esx4KTSy4mZjXA Sep 04 16:21:56.915950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:21:56.915950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:21:56.915950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:21:56.915950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:21:56.915950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Openstack-Nova-Api-Version: 2.20 Sep 04 16:21:56.915950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:21:56.915950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:21:56.915950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: 3219dc7400ec4957a31b1b0fabfd8c56 Sep 04 16:21:56.915950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-243620880 Sep 04 16:21:56.915950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:21:56.915950 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:21:56.917623 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3219dc7400ec4957a31b1b0fabfd8c56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3219dc7400ec4957a31b1b0fabfd8c56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3219dc7400ec4957a31b1b0fabfd8c56", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3219dc7400ec4957a31b1b0fabfd8c56"}]}] Sep 04 16:21:56.917623 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeShelveTestJSON-243620880 Sep 04 16:21:56.917623 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: 3219dc7400ec4957a31b1b0fabfd8c56 Sep 04 16:21:56.917623 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-243620880 Sep 04 16:21:56.917623 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-AttachVolumeShelveTestJSON-243620880-project Sep 04 16:21:56.917623 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:21:56.917623 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:21:56.917623 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: 1623e93ad6844cacae7cc1a71b339f22 Sep 04 16:21:56.917623 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeShelveTestJSON-243620880-project Sep 04 16:21:56.917623 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: > Sep 04 16:21:56.917623 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Instance 25192300-f22a-4b50-b390-17236f961eb5 could not be found. Sep 04 16:21:56.917623 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'id': '25192300-f22a-4b50-b390-17236f961eb5'} Sep 04 16:21:56.918515 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:21:56.918515 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:56.918515 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:21:56.918515 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:21:56.918515 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:21:56.918515 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:21:56.918515 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:21:56.918515 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:21:56.918515 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:21:56.918515 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:21:56.918515 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25192300-f22a-4b50-b390-17236f961eb5 could not be found. Sep 04 16:21:56.918515 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.918515 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:56.918515 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.918515 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:56.918515 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:56.918515 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:56.918515 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:21:56.918515 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:21:56.918515 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:21:56.920028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:21:56.920028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 04 16:21:56.920028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 04 16:21:56.920028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 04 16:21:56.920028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 04 16:21:56.920028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:21:56.920028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:21:56.920028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:21:56.920028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:21:56.920028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25192300-f22a-4b50-b390-17236f961eb5 could not be found. Sep 04 16:21:56.920028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.920028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:56.920028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.920028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:56.920028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:56.920028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:56.920028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:21:56.920028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:21:56.920028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25192300-f22a-4b50-b390-17236f961eb5 could not be found. Sep 04 16:21:56.920028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.921753 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b1355733-4aef-4357-b3d9-f395e9149b9f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Returning 404 to user: Instance 25192300-f22a-4b50-b390-17236f961eb5 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:21:56.921841 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-5ad4ad8b-e8cc-429a-8a06-13952571d0e7 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] HTTP exception thrown: Instance 9e5636f2-5f2f-45ca-af8a-d998079502df could not be found. Sep 04 16:21:56.921938 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b1355733-4aef-4357-b3d9-f395e9149b9f tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "DELETE /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 404 len: 111 microversion: 2.20 time: 0.038513 Sep 04 16:21:56.922031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5ad4ad8b-e8cc-429a-8a06-13952571d0e7 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Request method failure captured: Sep 04 16:21:56.922031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df HTTP/1.1 Sep 04 16:21:56.922031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:21:56.922031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:21:56.922031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:21:56.922031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:21:56.922031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:21:56.922031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:21:56.922031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:21:56.922031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:21:56.922031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFM7CEjNpb-xR3hPJMPQ-wsTXSagT7BYEktfOgtljHhzvAeE20V1mpt42r1aF9sMAbjmPPVeaP94mwlrfyovEVPw6ArC_YpgCrCSBFtvcpj7IAtQcwG53eIdKr17VLDw7eStXYQicK9SnKgixnRa-ofn7JvVLgTmHvsJ-_KcGiq48xm4 Sep 04 16:21:56.922031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:21:56.922031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:21:56.922031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:21:56.922031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:21:56.922031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:21:56.922031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:21:56.922031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:21:56.922031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:56.922031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:21:56.922031 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:21:56.923548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1cc5ea4158344d5c8a35bc5783410620", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}] Sep 04 16:21:56.923548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:56.923548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:21:56.923548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:56.923548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:21:56.923548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:21:56.923548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:21:56.923548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: 6e5c22b631df4600b9f920120b67fc67 Sep 04 16:21:56.923548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:21:56.923548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: > Sep 04 16:21:56.923548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Instance 9e5636f2-5f2f-45ca-af8a-d998079502df could not be found. Sep 04 16:21:56.923548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': '9e5636f2-5f2f-45ca-af8a-d998079502df'} Sep 04 16:21:56.924430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:21:56.924430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:56.924430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:21:56.924430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:21:56.924430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:21:56.924430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:21:56.924430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:21:56.924430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:21:56.924430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:21:56.924430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:21:56.924430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e5636f2-5f2f-45ca-af8a-d998079502df could not be found. Sep 04 16:21:56.924430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.924430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:56.924430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.924430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:56.924430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:56.924430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:56.924430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:21:56.924430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:21:56.924430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:21:56.925874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:21:56.925874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:21:56.925874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:21:56.925874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:21:56.925874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:21:56.925874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:21:56.925874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:21:56.925874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e5636f2-5f2f-45ca-af8a-d998079502df could not be found. Sep 04 16:21:56.925874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.925874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:56.925874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.925874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:56.925874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:56.925874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:56.925874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:21:56.925874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:21:56.925874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e5636f2-5f2f-45ca-af8a-d998079502df could not be found. Sep 04 16:21:56.925874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.927194 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5ad4ad8b-e8cc-429a-8a06-13952571d0e7 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Returning 404 to user: Instance 9e5636f2-5f2f-45ca-af8a-d998079502df could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:21:56.927194 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5ad4ad8b-e8cc-429a-8a06-13952571d0e7 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df" status: 404 len: 111 microversion: 2.1 time: 0.037057 Sep 04 16:21:56.927194 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 523/1048] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:21:56 2022] GET /compute/v2.1/servers/9e5636f2-5f2f-45ca-af8a-d998079502df => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:21:56.927445 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 526/1049] 10.222.0.39 () {60 vars in 1280 bytes} [Sun Sep 4 16:21:56 2022] DELETE /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 04 16:21:56.927565 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-aba5e1a9-1190-4da5-a36e-5c14f060204d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:56.927565 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-aba5e1a9-1190-4da5-a36e-5c14f060204d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] [instance: 25192300-f22a-4b50-b390-17236f961eb5] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:56.928101 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f9a9f257-7230-4cf0-bf0e-5e66bc634c1d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:56.928357 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f9a9f257-7230-4cf0-bf0e-5e66bc634c1d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:56.932144 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aba5e1a9-1190-4da5-a36e-5c14f060204d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:56.932719 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aba5e1a9-1190-4da5-a36e-5c14f060204d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:56.933059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aba5e1a9-1190-4da5-a36e-5c14f060204d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:56.933781 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aba5e1a9-1190-4da5-a36e-5c14f060204d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:56.934110 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9a9f257-7230-4cf0-bf0e-5e66bc634c1d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:56.934237 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aba5e1a9-1190-4da5-a36e-5c14f060204d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:56.934578 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9a9f257-7230-4cf0-bf0e-5e66bc634c1d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:56.934703 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-aba5e1a9-1190-4da5-a36e-5c14f060204d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:56.935003 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9a9f257-7230-4cf0-bf0e-5e66bc634c1d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:56.936200 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9a9f257-7230-4cf0-bf0e-5e66bc634c1d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:56.936687 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9a9f257-7230-4cf0-bf0e-5e66bc634c1d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:56.937120 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9a9f257-7230-4cf0-bf0e-5e66bc634c1d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:56.948693 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-aba5e1a9-1190-4da5-a36e-5c14f060204d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] HTTP exception thrown: Instance 25192300-f22a-4b50-b390-17236f961eb5 could not be found. Sep 04 16:21:56.950259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-aba5e1a9-1190-4da5-a36e-5c14f060204d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Request method failure captured: Sep 04 16:21:56.950259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 HTTP/1.1 Sep 04 16:21:56.950259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:21:56.950259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:21:56.950259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:21:56.950259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:21:56.950259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:21:56.950259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:21:56.950259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:21:56.950259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:21:56.950259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFM66LdGBrKyEum4ImUpWqHnqyUTcOx-vYn5pH9Y6tWuUdEMtMHv_I1VFXcYlu9ggjltB-RbCpbzQMSJocPpbFiPZrd4_bOcYduI4ERdpxKwKkyGxzdKLmffAh5gijW50OZlJxNLfn2JQADs0eoXShr3D6U9xPmGe0Esx4KTSy4mZjXA Sep 04 16:21:56.950259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:21:56.950259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:21:56.950259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:21:56.950259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:21:56.950259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Openstack-Nova-Api-Version: 2.20 Sep 04 16:21:56.950259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:21:56.950259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:21:56.950259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: 3219dc7400ec4957a31b1b0fabfd8c56 Sep 04 16:21:56.950259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-243620880 Sep 04 16:21:56.950259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:21:56.950259 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:21:56.952432 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3219dc7400ec4957a31b1b0fabfd8c56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3219dc7400ec4957a31b1b0fabfd8c56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3219dc7400ec4957a31b1b0fabfd8c56", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3219dc7400ec4957a31b1b0fabfd8c56"}]}] Sep 04 16:21:56.952432 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeShelveTestJSON-243620880 Sep 04 16:21:56.952432 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 3219dc7400ec4957a31b1b0fabfd8c56 Sep 04 16:21:56.952432 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-243620880 Sep 04 16:21:56.952432 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeShelveTestJSON-243620880-project Sep 04 16:21:56.952432 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:21:56.952432 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:21:56.952432 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: 1623e93ad6844cacae7cc1a71b339f22 Sep 04 16:21:56.952432 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeShelveTestJSON-243620880-project Sep 04 16:21:56.952432 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: > Sep 04 16:21:56.952432 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Instance 25192300-f22a-4b50-b390-17236f961eb5 could not be found. Sep 04 16:21:56.952432 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': '25192300-f22a-4b50-b390-17236f961eb5'} Sep 04 16:21:56.953254 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:21:56.953254 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:56.953254 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:21:56.953254 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:21:56.953254 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:21:56.953254 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:21:56.953254 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:21:56.953254 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:21:56.953254 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:21:56.953254 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:21:56.953254 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25192300-f22a-4b50-b390-17236f961eb5 could not be found. Sep 04 16:21:56.953254 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.953254 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:56.953254 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.953254 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:56.953254 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:56.953254 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:56.953254 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:21:56.953254 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:21:56.953254 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:21:56.954585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:21:56.954585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:21:56.954585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:21:56.954585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:21:56.954585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:21:56.954585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:21:56.954585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:21:56.954585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25192300-f22a-4b50-b390-17236f961eb5 could not be found. Sep 04 16:21:56.954585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.954585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:56.954585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.954585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:56.954585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:56.954585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:56.954585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:21:56.954585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:21:56.954585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25192300-f22a-4b50-b390-17236f961eb5 could not be found. Sep 04 16:21:56.954585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.955766 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-f9a9f257-7230-4cf0-bf0e-5e66bc634c1d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] HTTP exception thrown: Instance 512e46e1-9291-44b3-b609-c1147f105f76 could not be found. Sep 04 16:21:56.955851 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-aba5e1a9-1190-4da5-a36e-5c14f060204d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] Returning 404 to user: Instance 25192300-f22a-4b50-b390-17236f961eb5 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:21:56.955851 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-aba5e1a9-1190-4da5-a36e-5c14f060204d tempest-AttachVolumeShelveTestJSON-243620880 tempest-AttachVolumeShelveTestJSON-243620880-project] 10.222.0.39 "GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5" status: 404 len: 111 microversion: 2.20 time: 0.030371 Sep 04 16:21:56.956023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f9a9f257-7230-4cf0-bf0e-5e66bc634c1d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Request method failure captured: Sep 04 16:21:56.956023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 HTTP/1.1 Sep 04 16:21:56.956023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:21:56.956023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:21:56.956023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:21:56.956023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 04 16:21:56.956023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:21:56.956023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:21:56.956023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:21:56.956023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:21:56.956023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFM7CEjNpb-xR3hPJMPQ-wsTXSagT7BYEktfOgtljHhzvAeE20V1mpt42r1aF9sMAbjmPPVeaP94mwlrfyovEVPw6ArC_YpgCrCSBFtvcpj7IAtQcwG53eIdKr17VLDw7eStXYQicK9SnKgixnRa-ofn7JvVLgTmHvsJ-_KcGiq48xm4 Sep 04 16:21:56.956023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:21:56.956023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:21:56.956023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:21:56.956023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:21:56.956023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:21:56.956023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:21:56.956023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:21:56.956023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:56.956023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:21:56.956023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:21:56.957272 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1cc5ea4158344d5c8a35bc5783410620", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}] Sep 04 16:21:56.957272 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:56.957272 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:21:56.957272 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:56.957272 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:21:56.957272 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:21:56.957272 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:21:56.957272 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: 6e5c22b631df4600b9f920120b67fc67 Sep 04 16:21:56.957272 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:21:56.957272 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: > Sep 04 16:21:56.957272 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Instance 512e46e1-9291-44b3-b609-c1147f105f76 could not be found. Sep 04 16:21:56.957272 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'id': '512e46e1-9291-44b3-b609-c1147f105f76'} Sep 04 16:21:56.962350 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:21:56.962350 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:56.962350 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:21:56.962350 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:21:56.962350 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:21:56.962350 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:21:56.962350 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:21:56.962350 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:21:56.962350 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:21:56.962350 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:21:56.962350 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 512e46e1-9291-44b3-b609-c1147f105f76 could not be found. Sep 04 16:21:56.962350 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.962350 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:56.962350 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.962350 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:56.962350 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:56.962350 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:56.962350 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:21:56.962350 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:21:56.962350 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:21:56.963859 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:21:56.963859 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 04 16:21:56.963859 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 04 16:21:56.963859 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 04 16:21:56.963859 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 04 16:21:56.963859 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:21:56.963859 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:21:56.963859 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:21:56.963859 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:21:56.963859 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 512e46e1-9291-44b3-b609-c1147f105f76 could not be found. Sep 04 16:21:56.963859 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.963859 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:56.963859 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.963859 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:56.963859 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:56.963859 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:56.963859 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:21:56.963859 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:21:56.963859 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 512e46e1-9291-44b3-b609-c1147f105f76 could not be found. Sep 04 16:21:56.963859 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.965811 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 524/1050] 10.222.0.39 () {60 vars in 1277 bytes} [Sun Sep 4 16:21:56 2022] GET /compute/v2.1/servers/25192300-f22a-4b50-b390-17236f961eb5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 04 16:21:56.965923 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f9a9f257-7230-4cf0-bf0e-5e66bc634c1d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Returning 404 to user: Instance 512e46e1-9291-44b3-b609-c1147f105f76 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:21:56.965923 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f9a9f257-7230-4cf0-bf0e-5e66bc634c1d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "DELETE /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 404 len: 111 microversion: 2.1 time: 0.033284 Sep 04 16:21:56.965923 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 527/1051] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:21:56 2022] DELETE /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 04 16:21:56.966233 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e7b55ee5-0de6-45ac-970f-fbe66b36196d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:56.966957 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e7b55ee5-0de6-45ac-970f-fbe66b36196d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 512e46e1-9291-44b3-b609-c1147f105f76] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:56.972945 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e7b55ee5-0de6-45ac-970f-fbe66b36196d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:56.973447 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e7b55ee5-0de6-45ac-970f-fbe66b36196d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:56.973876 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e7b55ee5-0de6-45ac-970f-fbe66b36196d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:56.974602 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e7b55ee5-0de6-45ac-970f-fbe66b36196d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:56.975045 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e7b55ee5-0de6-45ac-970f-fbe66b36196d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:56.975565 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e7b55ee5-0de6-45ac-970f-fbe66b36196d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:56.988684 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-e7b55ee5-0de6-45ac-970f-fbe66b36196d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] HTTP exception thrown: Instance 512e46e1-9291-44b3-b609-c1147f105f76 could not be found. Sep 04 16:21:56.990247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e7b55ee5-0de6-45ac-970f-fbe66b36196d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Request method failure captured: Sep 04 16:21:56.990247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 HTTP/1.1 Sep 04 16:21:56.990247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:21:56.990247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:21:56.990247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:21:56.990247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:21:56.990247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:21:56.990247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:21:56.990247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:21:56.990247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:21:56.990247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFM7CEjNpb-xR3hPJMPQ-wsTXSagT7BYEktfOgtljHhzvAeE20V1mpt42r1aF9sMAbjmPPVeaP94mwlrfyovEVPw6ArC_YpgCrCSBFtvcpj7IAtQcwG53eIdKr17VLDw7eStXYQicK9SnKgixnRa-ofn7JvVLgTmHvsJ-_KcGiq48xm4 Sep 04 16:21:56.990247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:21:56.990247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:21:56.990247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:21:56.990247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:21:56.990247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:21:56.990247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:21:56.990247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:21:56.990247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:56.990247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:21:56.990247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:21:56.991848 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1cc5ea4158344d5c8a35bc5783410620", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}] Sep 04 16:21:56.991848 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:56.991848 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:21:56.991848 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:56.991848 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:21:56.991848 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:21:56.991848 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:21:56.991848 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: 6e5c22b631df4600b9f920120b67fc67 Sep 04 16:21:56.991848 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:21:56.991848 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: > Sep 04 16:21:56.991848 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Instance 512e46e1-9291-44b3-b609-c1147f105f76 could not be found. Sep 04 16:21:56.991848 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': '512e46e1-9291-44b3-b609-c1147f105f76'} Sep 04 16:21:56.992655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:21:56.992655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:56.992655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:21:56.992655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:21:56.992655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:21:56.992655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:21:56.992655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:21:56.992655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:21:56.992655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:21:56.992655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:21:56.992655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 512e46e1-9291-44b3-b609-c1147f105f76 could not be found. Sep 04 16:21:56.992655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.992655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:56.992655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.992655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:56.992655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:56.992655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:56.992655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:21:56.992655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:21:56.992655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:21:56.994343 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:21:56.994343 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:21:56.994343 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:21:56.994343 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:21:56.994343 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:21:56.994343 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:21:56.994343 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:21:56.994343 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 512e46e1-9291-44b3-b609-c1147f105f76 could not be found. Sep 04 16:21:56.994343 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.994343 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:56.994343 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.994343 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:56.994343 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:56.994343 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:56.994343 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:21:56.994343 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:21:56.994343 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 512e46e1-9291-44b3-b609-c1147f105f76 could not be found. Sep 04 16:21:56.994343 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:56.995499 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e7b55ee5-0de6-45ac-970f-fbe66b36196d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Returning 404 to user: Instance 512e46e1-9291-44b3-b609-c1147f105f76 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:21:56.995499 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e7b55ee5-0de6-45ac-970f-fbe66b36196d tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76" status: 404 len: 111 microversion: 2.1 time: 0.029201 Sep 04 16:21:56.995499 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 525/1052] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:21:56 2022] GET /compute/v2.1/servers/512e46e1-9291-44b3-b609-c1147f105f76 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:21:58.296869 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d2fe863c-383a-4d7c-8b86-2d350cd1d9b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:58.297405 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d2fe863c-383a-4d7c-8b86-2d350cd1d9b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:58.303734 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2fe863c-383a-4d7c-8b86-2d350cd1d9b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:58.304205 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2fe863c-383a-4d7c-8b86-2d350cd1d9b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:58.304634 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2fe863c-383a-4d7c-8b86-2d350cd1d9b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:58.305316 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2fe863c-383a-4d7c-8b86-2d350cd1d9b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:58.305789 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2fe863c-383a-4d7c-8b86-2d350cd1d9b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:58.306205 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d2fe863c-383a-4d7c-8b86-2d350cd1d9b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:58.319695 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-d2fe863c-383a-4d7c-8b86-2d350cd1d9b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] HTTP exception thrown: Instance 449c2258-280e-405f-a3d1-498688a52529 could not be found. Sep 04 16:21:58.321159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d2fe863c-383a-4d7c-8b86-2d350cd1d9b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Request method failure captured: Sep 04 16:21:58.321159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 HTTP/1.1 Sep 04 16:21:58.321159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:21:58.321159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:21:58.321159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:21:58.321159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 04 16:21:58.321159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:21:58.321159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:21:58.321159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:21:58.321159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:21:58.321159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFM7CEjNpb-xR3hPJMPQ-wsTXSagT7BYEktfOgtljHhzvAeE20V1mpt42r1aF9sMAbjmPPVeaP94mwlrfyovEVPw6ArC_YpgCrCSBFtvcpj7IAtQcwG53eIdKr17VLDw7eStXYQicK9SnKgixnRa-ofn7JvVLgTmHvsJ-_KcGiq48xm4 Sep 04 16:21:58.321159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:21:58.321159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:21:58.321159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:21:58.321159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:21:58.321159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:21:58.321159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:21:58.321159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:21:58.321159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:58.321159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:21:58.321159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:21:58.322670 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1cc5ea4158344d5c8a35bc5783410620", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}] Sep 04 16:21:58.322670 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:58.322670 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:21:58.322670 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:58.322670 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:21:58.322670 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:21:58.322670 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:21:58.322670 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: 6e5c22b631df4600b9f920120b67fc67 Sep 04 16:21:58.322670 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:21:58.322670 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: > Sep 04 16:21:58.322670 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Instance 449c2258-280e-405f-a3d1-498688a52529 could not be found. Sep 04 16:21:58.322670 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'id': '449c2258-280e-405f-a3d1-498688a52529'} Sep 04 16:21:58.323413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:21:58.323413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:58.323413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:21:58.323413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:21:58.323413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:21:58.323413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:21:58.323413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:21:58.323413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:21:58.323413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:21:58.323413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:21:58.323413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 449c2258-280e-405f-a3d1-498688a52529 could not be found. Sep 04 16:21:58.323413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:58.323413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:58.323413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:58.323413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:58.323413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:58.323413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:58.323413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:21:58.323413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:21:58.323413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:21:58.324603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:21:58.324603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 04 16:21:58.324603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 04 16:21:58.324603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 04 16:21:58.324603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 04 16:21:58.324603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:21:58.324603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:21:58.324603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:21:58.324603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:21:58.324603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 449c2258-280e-405f-a3d1-498688a52529 could not be found. Sep 04 16:21:58.324603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:58.324603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:58.324603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:58.324603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:58.324603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:58.324603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:58.324603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:21:58.324603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:21:58.324603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 449c2258-280e-405f-a3d1-498688a52529 could not be found. Sep 04 16:21:58.324603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:21:58.325898 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d2fe863c-383a-4d7c-8b86-2d350cd1d9b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Returning 404 to user: Instance 449c2258-280e-405f-a3d1-498688a52529 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:21:58.325898 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d2fe863c-383a-4d7c-8b86-2d350cd1d9b8 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "DELETE /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 404 len: 111 microversion: 2.1 time: 0.029874 Sep 04 16:21:58.325898 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 528/1053] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:21:58 2022] DELETE /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:21:58.331599 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fc22d79a-0152-4006-8810-42b85cbc75a2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:21:58.332208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fc22d79a-0152-4006-8810-42b85cbc75a2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] [instance: 449c2258-280e-405f-a3d1-498688a52529] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:21:58.338800 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc22d79a-0152-4006-8810-42b85cbc75a2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:58.339282 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc22d79a-0152-4006-8810-42b85cbc75a2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:58.339711 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc22d79a-0152-4006-8810-42b85cbc75a2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:58.340409 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc22d79a-0152-4006-8810-42b85cbc75a2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:21:58.340856 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc22d79a-0152-4006-8810-42b85cbc75a2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:21:58.341272 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fc22d79a-0152-4006-8810-42b85cbc75a2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:21:58.355307 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-fc22d79a-0152-4006-8810-42b85cbc75a2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] HTTP exception thrown: Instance 449c2258-280e-405f-a3d1-498688a52529 could not be found. Sep 04 16:21:58.356928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fc22d79a-0152-4006-8810-42b85cbc75a2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Request method failure captured: Sep 04 16:21:58.356928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 HTTP/1.1 Sep 04 16:21:58.356928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:21:58.356928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:21:58.356928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:21:58.356928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:21:58.356928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:21:58.356928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:21:58.356928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:21:58.356928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:21:58.356928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFM7CEjNpb-xR3hPJMPQ-wsTXSagT7BYEktfOgtljHhzvAeE20V1mpt42r1aF9sMAbjmPPVeaP94mwlrfyovEVPw6ArC_YpgCrCSBFtvcpj7IAtQcwG53eIdKr17VLDw7eStXYQicK9SnKgixnRa-ofn7JvVLgTmHvsJ-_KcGiq48xm4 Sep 04 16:21:58.356928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:21:58.356928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:21:58.356928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:21:58.356928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:21:58.356928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:21:58.356928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:21:58.356928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:21:58.356928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:58.356928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:21:58.356928 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:21:58.358555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1cc5ea4158344d5c8a35bc5783410620", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1cc5ea4158344d5c8a35bc5783410620"}]}] Sep 04 16:21:58.358555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:58.358555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 1cc5ea4158344d5c8a35bc5783410620 Sep 04 16:21:58.358555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1911368077 Sep 04 16:21:58.358555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:21:58.358555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:21:58.358555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:21:58.358555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: 6e5c22b631df4600b9f920120b67fc67 Sep 04 16:21:58.358555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeNegativeTest-1911368077-project Sep 04 16:21:58.358555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: > Sep 04 16:21:58.358555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Instance 449c2258-280e-405f-a3d1-498688a52529 could not be found. Sep 04 16:21:58.358555 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': '449c2258-280e-405f-a3d1-498688a52529'} Sep 04 16:21:58.359540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:21:58.359540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:58.359540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:21:58.359540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:21:58.359540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:21:58.359540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:21:58.359540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:21:58.359540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:21:58.359540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:21:58.359540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:21:58.359540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 449c2258-280e-405f-a3d1-498688a52529 could not be found. Sep 04 16:21:58.359540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:58.359540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:58.359540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:58.359540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:58.359540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:58.359540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:58.359540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:21:58.359540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:21:58.359540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:21:58.360987 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:21:58.360987 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:21:58.360987 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:21:58.360987 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:21:58.360987 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:21:58.360987 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:21:58.360987 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:21:58.360987 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 449c2258-280e-405f-a3d1-498688a52529 could not be found. Sep 04 16:21:58.360987 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:58.360987 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:21:58.360987 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:58.360987 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:21:58.360987 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:21:58.360987 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:21:58.360987 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:21:58.360987 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:21:58.360987 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 449c2258-280e-405f-a3d1-498688a52529 could not be found. Sep 04 16:21:58.360987 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:21:58.362484 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fc22d79a-0152-4006-8810-42b85cbc75a2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] Returning 404 to user: Instance 449c2258-280e-405f-a3d1-498688a52529 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:21:58.362484 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fc22d79a-0152-4006-8810-42b85cbc75a2 tempest-AttachVolumeNegativeTest-1911368077 tempest-AttachVolumeNegativeTest-1911368077-project] 10.222.0.39 "GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529" status: 404 len: 111 microversion: 2.1 time: 0.030536 Sep 04 16:21:58.362484 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 526/1054] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:21:58 2022] GET /compute/v2.1/servers/449c2258-280e-405f-a3d1-498688a52529 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 04 16:22:04.453555 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1df0e2e4-3fdf-4c6c-8080-6cc2dae0866d tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Action: 'create', calling method: .version_select at 0x7f96890eda60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-155988941"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:22:05.146623 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1df0e2e4-3fdf-4c6c-8080-6cc2dae0866d tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.838886 Sep 04 16:22:05.147425 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 529/1055] 10.222.0.39 () {60 vars in 1155 bytes} [Sun Sep 4 16:22:04 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 840 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 04 16:22:05.161332 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-88aae9de-3e7e-4723-a3bc-ba272fb1d85e tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Calling method '.version_select at 0x7f9689235dc0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:05.224966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-88aae9de-3e7e-4723-a3bc-ba272fb1d85e tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/676900b0-0fb1-4505-a1e3-0dcfc4b11302" status: 200 len: 344 microversion: 2.1 time: 0.066387 Sep 04 16:22:05.224966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 527/1056] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Sep 4 16:22:05 2022] GET /compute/v2.1/os-volumes/676900b0-0fb1-4505-a1e3-0dcfc4b11302 => generated 344 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:22:06.241717 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8b06c4d1-3b0e-413e-ab10-959e997a5abb tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Calling method '.version_select at 0x7f96895e41f0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:06.308044 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8b06c4d1-3b0e-413e-ab10-959e997a5abb tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/676900b0-0fb1-4505-a1e3-0dcfc4b11302" status: 200 len: 345 microversion: 2.1 time: 0.071357 Sep 04 16:22:06.308622 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 530/1057] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Sep 4 16:22:06 2022] GET /compute/v2.1/os-volumes/676900b0-0fb1-4505-a1e3-0dcfc4b11302 => generated 345 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:22:06.327449 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9ebfd4fb-8559-4c87-8b2a-6923a1c00c2c tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Action: 'create', calling method: .version_select at 0x7f96891eb5e0>, body: {"snapshot": {"volume_id": "676900b0-0fb1-4505-a1e3-0dcfc4b11302", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1545254672"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:22:06.888394 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9ebfd4fb-8559-4c87-8b2a-6923a1c00c2c tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] 10.222.0.39 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.565374 Sep 04 16:22:06.893092 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 528/1058] 10.222.0.39 () {60 vars in 1162 bytes} [Sun Sep 4 16:22:06 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:22:06.901806 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3950ab1f-367c-444c-aced-3d5059fa3d9f tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Calling method '.version_select at 0x7f96891d9f70>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:06.933870 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3950ab1f-367c-444c-aced-3d5059fa3d9f tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/99660daa-3fe4-4b15-8586-cf48113d5318" status: 200 len: 287 microversion: 2.1 time: 0.037151 Sep 04 16:22:06.934437 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 531/1059] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Sep 4 16:22:06 2022] GET /compute/v2.1/os-snapshots/99660daa-3fe4-4b15-8586-cf48113d5318 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:22:06.945575 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f7902491-f96e-4fda-8f72-624d3c3c419e tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Calling method '.version_select at 0x7f9689073820>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:06.979547 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f7902491-f96e-4fda-8f72-624d3c3c419e tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.037679 Sep 04 16:22:06.980482 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 529/1060] 10.222.0.39 () {58 vars in 1140 bytes} [Sun Sep 4 16:22:06 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:22:06.993725 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e16d66d0-aa2f-41e3-8fd1-1fad9617e293 tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Calling method '.version_select at 0x7f96891bca60>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:07.024607 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e16d66d0-aa2f-41e3-8fd1-1fad9617e293 tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/99660daa-3fe4-4b15-8586-cf48113d5318" status: 200 len: 287 microversion: 2.1 time: 0.035620 Sep 04 16:22:07.025171 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 532/1061] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Sep 4 16:22:06 2022] GET /compute/v2.1/os-snapshots/99660daa-3fe4-4b15-8586-cf48113d5318 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:22:08.039201 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a662a13c-0317-412b-8a0d-ccf9e7778b9d tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Calling method '.version_select at 0x7f96892a6550>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:08.075282 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a662a13c-0317-412b-8a0d-ccf9e7778b9d tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/99660daa-3fe4-4b15-8586-cf48113d5318" status: 200 len: 287 microversion: 2.1 time: 0.040785 Sep 04 16:22:08.081409 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 530/1062] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Sep 4 16:22:08 2022] GET /compute/v2.1/os-snapshots/99660daa-3fe4-4b15-8586-cf48113d5318 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:22:08.904451 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:22:08.905901 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:22:08.957522 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-155437b4-26b9-450a-9d5a-a53db1610285 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Action: 'create', calling method: .version_select at 0x7f96890adb80>, body: {"keypair": {"name": "tempest-keypair-1638602846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL36KyOGG8mE23wnsc6/DN4VRiXVZfxLNjrRBGJqRfbXtcwRtsCyrKCPZtTU0QVCMi+iBeZ+a9IHFtffziuOMuo7bScUYsmfQ5NXZyv7IPoUnusarzEwxx9oSMy/E2Srmg=="}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:22:08.974707 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-155437b4-26b9-450a-9d5a-a53db1610285 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Getting quotas for project 6dde43a19e95472d87ea4273922156be. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:22:08.978532 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-155437b4-26b9-450a-9d5a-a53db1610285 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Getting quotas for user b1fa7bf738264e77b868ce9d7863214e and project 6dde43a19e95472d87ea4273922156be. Resources: {'key_pairs'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:22:09.059831 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-155437b4-26b9-450a-9d5a-a53db1610285 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.156633 Sep 04 16:22:09.061007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 533/1063] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Sep 4 16:22:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:22:09.085226 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:22:09.086148 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:22:09.090717 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4bc03c3b-37c2-40d9-8a3c-9550aca90e2a tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Calling method '.version_select at 0x7f96895e5040>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:09.120925 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4bc03c3b-37c2-40d9-8a3c-9550aca90e2a tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/99660daa-3fe4-4b15-8586-cf48113d5318" status: 200 len: 287 microversion: 2.1 time: 0.036459 Sep 04 16:22:09.121501 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 531/1064] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Sep 4 16:22:09 2022] GET /compute/v2.1/os-snapshots/99660daa-3fe4-4b15-8586-cf48113d5318 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:22:10.135837 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f00e65a9-d05c-435d-bd88-463443a461c6 tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Calling method '.version_select at 0x7f96891d91f0>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:10.170837 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f00e65a9-d05c-435d-bd88-463443a461c6 tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/99660daa-3fe4-4b15-8586-cf48113d5318" status: 200 len: 288 microversion: 2.1 time: 0.040442 Sep 04 16:22:10.174671 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 534/1065] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Sep 4 16:22:10 2022] GET /compute/v2.1/os-snapshots/99660daa-3fe4-4b15-8586-cf48113d5318 => generated 288 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:22:10.183864 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-08afb4e9-19d1-4e3f-81a7-cd7c0fc0330f tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Calling method '.version_select at 0x7f96891ebaf0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:10.299178 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-08afb4e9-19d1-4e3f-81a7-cd7c0fc0330f tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] 10.222.0.39 "DELETE /compute/v2.1/os-snapshots/99660daa-3fe4-4b15-8586-cf48113d5318" status: 202 len: 0 microversion: 2.1 time: 0.119884 Sep 04 16:22:10.300026 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 532/1066] 10.222.0.39 () {58 vars in 1254 bytes} [Sun Sep 4 16:22:10 2022] DELETE /compute/v2.1/os-snapshots/99660daa-3fe4-4b15-8586-cf48113d5318 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:22:10.310492 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aee11247-8b87-4d1d-ad33-66821c21b661 tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Calling method '.version_select at 0x7f96891d9f70>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:10.352790 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aee11247-8b87-4d1d-ad33-66821c21b661 tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/99660daa-3fe4-4b15-8586-cf48113d5318" status: 200 len: 287 microversion: 2.1 time: 0.047306 Sep 04 16:22:10.353336 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 535/1067] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Sep 4 16:22:10 2022] GET /compute/v2.1/os-snapshots/99660daa-3fe4-4b15-8586-cf48113d5318 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:22:11.371622 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3b70c9d5-b230-4a4d-a0aa-455341f0d743 tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Calling method '.version_select at 0x7f96891bb1f0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:11.399381 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-3b70c9d5-b230-4a4d-a0aa-455341f0d743 tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] HTTP exception thrown: Snapshot 99660daa-3fe4-4b15-8586-cf48113d5318 could not be found. Sep 04 16:22:11.408840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3b70c9d5-b230-4a4d-a0aa-455341f0d743 tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Request method failure captured: Sep 04 16:22:11.408840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/os-snapshots/99660daa-3fe4-4b15-8586-cf48113d5318 HTTP/1.1 Sep 04 16:22:11.408840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:22:11.408840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:22:11.408840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:22:11.408840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:22:11.408840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:22:11.408840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:22:11.408840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:22:11.408840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:22:11.408840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFNCsF4eXd9RPhstyNFQc7xek0AmLbORGvLzyNWvmFMwxa4HJpoJSt0M5-jR4m-cssY_P5Syp9w-qD3wmUJHvDylTgvTiE3mX3RPjefIpGK8c9xdyVMQ5YYrA3kg0WYJ229QTc6nAhkiFXWL7Mb8irGmvU7CQO2BySp05vtXq8tgoXxw Sep 04 16:22:11.408840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:22:11.408840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:22:11.408840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:22:11.408840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:22:11.408840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:22:11.408840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:22:11.408840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: cf5f20da263e45abb540fa062ab9aa19 Sep 04 16:22:11.408840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-531724680 Sep 04 16:22:11.408840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:22:11.408840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:22:11.416442 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cf5f20da263e45abb540fa062ab9aa19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cf5f20da263e45abb540fa062ab9aa19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cf5f20da263e45abb540fa062ab9aa19", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cf5f20da263e45abb540fa062ab9aa19"}]}] Sep 04 16:22:11.416442 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-VolumesSnapshotsTestJSON-531724680 Sep 04 16:22:11.416442 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: cf5f20da263e45abb540fa062ab9aa19 Sep 04 16:22:11.416442 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-531724680 Sep 04 16:22:11.416442 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-VolumesSnapshotsTestJSON-531724680-project Sep 04 16:22:11.416442 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:22:11.416442 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:22:11.416442 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: 6e6309d0ca0b452f8e05632349fb17d6 Sep 04 16:22:11.416442 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-VolumesSnapshotsTestJSON-531724680-project Sep 04 16:22:11.416442 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: Sep 04 16:22:11.416442 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Snapshot 99660daa-3fe4-4b15-8586-cf48113d5318 could not be found. Sep 04 16:22:11.416442 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': '99660daa-3fe4-4b15-8586-cf48113d5318'} Sep 04 16:22:11.416442 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:22:11.417630 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:11.417630 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 04 16:22:11.417630 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 04 16:22:11.417630 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 04 16:22:11.417630 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 04 16:22:11.417630 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 04 16:22:11.417630 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 04 16:22:11.417630 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 04 16:22:11.417630 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 04 16:22:11.417630 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 04 16:22:11.417630 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 04 16:22:11.417630 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 16:22:11.417630 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 16:22:11.417630 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 16:22:11.417630 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 16:22:11.417630 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 99660daa-3fe4-4b15-8586-cf48113d5318 could not be found. (HTTP 404) (Request-ID: req-27c98f8d-db7e-48ca-a0e4-fbf583dbfa3a) Sep 04 16:22:11.417630 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:11.417630 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:11.419014 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:11.419014 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:11.419014 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 04 16:22:11.419014 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 04 16:22:11.419014 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 04 16:22:11.419014 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 04 16:22:11.419014 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 04 16:22:11.419014 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 04 16:22:11.419014 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 04 16:22:11.419014 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 04 16:22:11.419014 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 04 16:22:11.419014 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 04 16:22:11.419014 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 04 16:22:11.419014 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 04 16:22:11.419014 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 04 16:22:11.419014 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 04 16:22:11.419014 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 04 16:22:11.419014 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 04 16:22:11.419014 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 04 16:22:11.420497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 04 16:22:11.420497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 16:22:11.420497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 16:22:11.420497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 16:22:11.420497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 16:22:11.420497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 99660daa-3fe4-4b15-8586-cf48113d5318 could not be found. Sep 04 16:22:11.420497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:11.420497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:11.420497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:11.420497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:11.420497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:22:11.420497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:22:11.420497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:22:11.420497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:22:11.420497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 04 16:22:11.420497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 04 16:22:11.420497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:22:11.420497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:22:11.420497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 04 16:22:11.420497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:22:11.422638 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 99660daa-3fe4-4b15-8586-cf48113d5318 could not be found. Sep 04 16:22:11.422638 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:11.422638 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:11.422638 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:11.422638 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:11.422638 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:22:11.422638 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:22:11.422638 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:22:11.422638 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:22:11.422638 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 99660daa-3fe4-4b15-8586-cf48113d5318 could not be found. Sep 04 16:22:11.422638 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:11.422638 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3b70c9d5-b230-4a4d-a0aa-455341f0d743 tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Returning 404 to user: Snapshot 99660daa-3fe4-4b15-8586-cf48113d5318 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:22:11.422638 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3b70c9d5-b230-4a4d-a0aa-455341f0d743 tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/99660daa-3fe4-4b15-8586-cf48113d5318" status: 404 len: 111 microversion: 2.1 time: 0.048252 Sep 04 16:22:11.423778 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 533/1068] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Sep 4 16:22:11 2022] GET /compute/v2.1/os-snapshots/99660daa-3fe4-4b15-8586-cf48113d5318 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 04 16:22:11.424092 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ac21d7a8-0fa3-46f9-9f19-309eecfc384e tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Calling method '.version_select at 0x7f9689259d30>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:11.428274 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-90687ec6-4062-497a-b58d-b0223670033c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2094718700", "imageRef": "11a460f6-29b0-46e6-ae98-e53ee2e13520", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c473da39-bd28-4e2e-830f-12458827922d"}], "security_groups": [{"name": "tempest-securitygroup--2031533816"}], "key_name": "tempest-keypair-1638602846", "user_data": "}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:22:11.542319 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-90687ec6-4062-497a-b58d-b0223670033c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] validate_networks() for [('c473da39-bd28-4e2e-830f-12458827922d', None, None, None, None, None)] {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 16:22:11.632079 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ac21d7a8-0fa3-46f9-9f19-309eecfc384e tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/676900b0-0fb1-4505-a1e3-0dcfc4b11302" status: 202 len: 0 microversion: 2.1 time: 0.211844 Sep 04 16:22:11.636194 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 536/1069] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Sep 4 16:22:11 2022] DELETE /compute/v2.1/os-volumes/676900b0-0fb1-4505-a1e3-0dcfc4b11302 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:22:11.643396 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1337ffc1-dd4d-4afc-8470-556aab7dc1e3 tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Calling method '.version_select at 0x7f9689259790>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:11.717709 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1337ffc1-dd4d-4afc-8470-556aab7dc1e3 tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/676900b0-0fb1-4505-a1e3-0dcfc4b11302" status: 200 len: 344 microversion: 2.1 time: 0.079419 Sep 04 16:22:11.717946 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 537/1070] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Sep 4 16:22:11 2022] GET /compute/v2.1/os-volumes/676900b0-0fb1-4505-a1e3-0dcfc4b11302 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:22:11.944939 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-90687ec6-4062-497a-b58d-b0223670033c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 16:22:11.947526 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-90687ec6-4062-497a-b58d-b0223670033c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 16:22:11.947526 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-90687ec6-4062-497a-b58d-b0223670033c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 16:22:11.947526 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-90687ec6-4062-497a-b58d-b0223670033c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 16:22:11.947526 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-90687ec6-4062-497a-b58d-b0223670033c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 16:22:11.958154 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90687ec6-4062-497a-b58d-b0223670033c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:11.958731 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90687ec6-4062-497a-b58d-b0223670033c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:11.959453 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90687ec6-4062-497a-b58d-b0223670033c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:11.960252 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90687ec6-4062-497a-b58d-b0223670033c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:11.960786 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90687ec6-4062-497a-b58d-b0223670033c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:11.961225 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-90687ec6-4062-497a-b58d-b0223670033c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:11.979385 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-90687ec6-4062-497a-b58d-b0223670033c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Getting quotas for project 6dde43a19e95472d87ea4273922156be. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:22:11.984490 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-90687ec6-4062-497a-b58d-b0223670033c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Getting quotas for user b1fa7bf738264e77b868ce9d7863214e and project 6dde43a19e95472d87ea4273922156be. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:22:11.997195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-90687ec6-4062-497a-b58d-b0223670033c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 16:22:11.999712 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-90687ec6-4062-497a-b58d-b0223670033c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a460f6-29b0-46e6-ae98-e53ee2e13520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 16:22:12.098049 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-90687ec6-4062-497a-b58d-b0223670033c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.675140 Sep 04 16:22:12.098987 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 534/1071] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Sep 4 16:22:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 16:22:12.110619 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c9bdc89d-ff7c-4f25-a584-0cd1f116110e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:12.111317 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c9bdc89d-ff7c-4f25-a584-0cd1f116110e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:12.175383 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c9bdc89d-ff7c-4f25-a584-0cd1f116110e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:12.186962 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c9bdc89d-ff7c-4f25-a584-0cd1f116110e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1238 microversion: 2.1 time: 0.080785 Sep 04 16:22:12.187607 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 538/1072] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:12 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:22:12.732018 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1c272117-a158-4b28-bca2-3718b1ed2cf4 tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Calling method '.version_select at 0x7f96891ebee0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:12.760938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-1c272117-a158-4b28-bca2-3718b1ed2cf4 tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] HTTP exception thrown: Volume 676900b0-0fb1-4505-a1e3-0dcfc4b11302 could not be found. Sep 04 16:22:12.762905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1c272117-a158-4b28-bca2-3718b1ed2cf4 tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Request method failure captured: Sep 04 16:22:12.762905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/os-volumes/676900b0-0fb1-4505-a1e3-0dcfc4b11302 HTTP/1.1 Sep 04 16:22:12.762905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:22:12.762905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:22:12.762905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:22:12.762905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:22:12.762905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:22:12.762905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:22:12.762905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:22:12.762905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:22:12.762905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFNCsF4eXd9RPhstyNFQc7xek0AmLbORGvLzyNWvmFMwxa4HJpoJSt0M5-jR4m-cssY_P5Syp9w-qD3wmUJHvDylTgvTiE3mX3RPjefIpGK8c9xdyVMQ5YYrA3kg0WYJ229QTc6nAhkiFXWL7Mb8irGmvU7CQO2BySp05vtXq8tgoXxw Sep 04 16:22:12.762905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:22:12.762905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:22:12.762905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:22:12.762905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:22:12.762905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:22:12.762905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:22:12.762905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: cf5f20da263e45abb540fa062ab9aa19 Sep 04 16:22:12.762905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-531724680 Sep 04 16:22:12.762905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:22:12.762905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:22:12.764492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cf5f20da263e45abb540fa062ab9aa19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cf5f20da263e45abb540fa062ab9aa19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cf5f20da263e45abb540fa062ab9aa19", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cf5f20da263e45abb540fa062ab9aa19"}]}] Sep 04 16:22:12.764492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-VolumesSnapshotsTestJSON-531724680 Sep 04 16:22:12.764492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: cf5f20da263e45abb540fa062ab9aa19 Sep 04 16:22:12.764492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-531724680 Sep 04 16:22:12.764492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-VolumesSnapshotsTestJSON-531724680-project Sep 04 16:22:12.764492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:22:12.764492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:22:12.764492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: 6e6309d0ca0b452f8e05632349fb17d6 Sep 04 16:22:12.764492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-VolumesSnapshotsTestJSON-531724680-project Sep 04 16:22:12.764492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: Sep 04 16:22:12.764492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Volume 676900b0-0fb1-4505-a1e3-0dcfc4b11302 could not be found. Sep 04 16:22:12.764492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': '676900b0-0fb1-4505-a1e3-0dcfc4b11302'} Sep 04 16:22:12.764492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:22:12.765946 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:12.765946 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 16:22:12.765946 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 16:22:12.765946 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 04 16:22:12.765946 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 04 16:22:12.765946 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 04 16:22:12.765946 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 04 16:22:12.765946 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 04 16:22:12.765946 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 04 16:22:12.765946 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 04 16:22:12.765946 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 04 16:22:12.765946 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 16:22:12.765946 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 16:22:12.765946 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 16:22:12.765946 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 16:22:12.765946 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 676900b0-0fb1-4505-a1e3-0dcfc4b11302 could not be found. (HTTP 404) (Request-ID: req-29c6e3a9-184d-4ee1-804d-7f4b6704620d) Sep 04 16:22:12.765946 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:12.765946 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:12.765946 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:12.767334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:12.767334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 04 16:22:12.767334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 04 16:22:12.767334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 04 16:22:12.767334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 04 16:22:12.767334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 04 16:22:12.767334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 04 16:22:12.767334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 04 16:22:12.767334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 04 16:22:12.767334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 16:22:12.767334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 16:22:12.767334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 04 16:22:12.767334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 04 16:22:12.767334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 04 16:22:12.767334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 04 16:22:12.767334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 04 16:22:12.767334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 04 16:22:12.767334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 04 16:22:12.767334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 04 16:22:12.768545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 16:22:12.768545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 16:22:12.768545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 16:22:12.768545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 16:22:12.768545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 676900b0-0fb1-4505-a1e3-0dcfc4b11302 could not be found. Sep 04 16:22:12.768545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:12.768545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:12.768545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:12.768545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:12.768545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:22:12.768545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:22:12.768545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:22:12.768545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:22:12.768545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 04 16:22:12.768545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 04 16:22:12.768545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:22:12.768545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:22:12.768545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 04 16:22:12.768545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:22:12.769828 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 676900b0-0fb1-4505-a1e3-0dcfc4b11302 could not be found. Sep 04 16:22:12.769828 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:12.769828 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:12.769828 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:12.769828 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:12.769828 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:22:12.769828 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:22:12.769828 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:22:12.769828 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:22:12.769828 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 676900b0-0fb1-4505-a1e3-0dcfc4b11302 could not be found. Sep 04 16:22:12.769828 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:12.769828 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1c272117-a158-4b28-bca2-3718b1ed2cf4 tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Returning 404 to user: Volume 676900b0-0fb1-4505-a1e3-0dcfc4b11302 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:22:12.769828 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1c272117-a158-4b28-bca2-3718b1ed2cf4 tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/676900b0-0fb1-4505-a1e3-0dcfc4b11302" status: 404 len: 109 microversion: 2.1 time: 0.036434 Sep 04 16:22:12.769828 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 535/1073] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Sep 4 16:22:12 2022] GET /compute/v2.1/os-volumes/676900b0-0fb1-4505-a1e3-0dcfc4b11302 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:22:12.776271 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-09060591-0282-4037-b02d-3be27ab637fc tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Calling method '.version_select at 0x7f9689194940>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:12.809225 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-09060591-0282-4037-b02d-3be27ab637fc tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] HTTP exception thrown: Volume 676900b0-0fb1-4505-a1e3-0dcfc4b11302 could not be found. Sep 04 16:22:12.813176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-09060591-0282-4037-b02d-3be27ab637fc tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Request method failure captured: Sep 04 16:22:12.813176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: DELETE /compute/v2.1/os-volumes/676900b0-0fb1-4505-a1e3-0dcfc4b11302 HTTP/1.1 Sep 04 16:22:12.813176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:22:12.813176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:22:12.813176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:22:12.813176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 04 16:22:12.813176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:22:12.813176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:22:12.813176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:22:12.813176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:22:12.813176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFNCsF4eXd9RPhstyNFQc7xek0AmLbORGvLzyNWvmFMwxa4HJpoJSt0M5-jR4m-cssY_P5Syp9w-qD3wmUJHvDylTgvTiE3mX3RPjefIpGK8c9xdyVMQ5YYrA3kg0WYJ229QTc6nAhkiFXWL7Mb8irGmvU7CQO2BySp05vtXq8tgoXxw Sep 04 16:22:12.813176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:22:12.813176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:22:12.813176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:22:12.813176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:22:12.813176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:22:12.813176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:22:12.813176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: cf5f20da263e45abb540fa062ab9aa19 Sep 04 16:22:12.813176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-531724680 Sep 04 16:22:12.813176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:22:12.813176 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:22:12.814763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cf5f20da263e45abb540fa062ab9aa19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cf5f20da263e45abb540fa062ab9aa19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cf5f20da263e45abb540fa062ab9aa19", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cf5f20da263e45abb540fa062ab9aa19"}]}] Sep 04 16:22:12.814763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-VolumesSnapshotsTestJSON-531724680 Sep 04 16:22:12.814763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: cf5f20da263e45abb540fa062ab9aa19 Sep 04 16:22:12.814763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-531724680 Sep 04 16:22:12.814763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-VolumesSnapshotsTestJSON-531724680-project Sep 04 16:22:12.814763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:22:12.814763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:22:12.814763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: 6e6309d0ca0b452f8e05632349fb17d6 Sep 04 16:22:12.814763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-VolumesSnapshotsTestJSON-531724680-project Sep 04 16:22:12.814763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: Sep 04 16:22:12.814763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Volume 676900b0-0fb1-4505-a1e3-0dcfc4b11302 could not be found. Sep 04 16:22:12.814763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'id': '676900b0-0fb1-4505-a1e3-0dcfc4b11302'} Sep 04 16:22:12.814763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:22:12.815736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:12.815736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 16:22:12.815736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 16:22:12.815736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 04 16:22:12.815736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 04 16:22:12.815736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 04 16:22:12.815736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 04 16:22:12.815736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 04 16:22:12.815736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 04 16:22:12.815736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 04 16:22:12.815736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 04 16:22:12.815736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 16:22:12.815736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 16:22:12.815736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 16:22:12.815736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 16:22:12.815736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 676900b0-0fb1-4505-a1e3-0dcfc4b11302 could not be found. (HTTP 404) (Request-ID: req-21a5bb76-89f9-4f9d-b11c-542fddff4bda) Sep 04 16:22:12.815736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:12.815736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:12.815736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:12.817188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:12.817188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 04 16:22:12.817188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 04 16:22:12.817188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 04 16:22:12.817188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 04 16:22:12.817188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 04 16:22:12.817188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 04 16:22:12.817188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 04 16:22:12.817188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 04 16:22:12.817188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 16:22:12.817188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 16:22:12.817188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 04 16:22:12.817188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 04 16:22:12.817188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 04 16:22:12.817188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 04 16:22:12.817188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 04 16:22:12.817188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 04 16:22:12.817188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 04 16:22:12.817188 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 04 16:22:12.819657 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 16:22:12.819657 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 16:22:12.819657 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 16:22:12.819657 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 16:22:12.819657 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 676900b0-0fb1-4505-a1e3-0dcfc4b11302 could not be found. Sep 04 16:22:12.819657 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:12.819657 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:12.819657 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:12.819657 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:12.819657 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:22:12.819657 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:22:12.819657 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:22:12.819657 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:22:12.819657 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 04 16:22:12.819657 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 04 16:22:12.819657 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:22:12.819657 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:22:12.819657 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 04 16:22:12.819657 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:22:12.821016 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 676900b0-0fb1-4505-a1e3-0dcfc4b11302 could not be found. Sep 04 16:22:12.821016 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:12.821016 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:12.821016 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:12.821016 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:12.821016 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:22:12.821016 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:22:12.821016 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:22:12.821016 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:22:12.821016 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 676900b0-0fb1-4505-a1e3-0dcfc4b11302 could not be found. Sep 04 16:22:12.821016 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:12.821016 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-09060591-0282-4037-b02d-3be27ab637fc tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Returning 404 to user: Volume 676900b0-0fb1-4505-a1e3-0dcfc4b11302 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:22:12.821016 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-09060591-0282-4037-b02d-3be27ab637fc tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/676900b0-0fb1-4505-a1e3-0dcfc4b11302" status: 404 len: 109 microversion: 2.1 time: 0.047471 Sep 04 16:22:12.821016 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 539/1074] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Sep 4 16:22:12 2022] DELETE /compute/v2.1/os-volumes/676900b0-0fb1-4505-a1e3-0dcfc4b11302 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 04 16:22:12.829218 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9fd8d662-5d40-4ae7-846f-3b61d7d5e1ae tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Calling method '.version_select at 0x7f968905adc0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:12.864098 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-9fd8d662-5d40-4ae7-846f-3b61d7d5e1ae tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] HTTP exception thrown: Volume 676900b0-0fb1-4505-a1e3-0dcfc4b11302 could not be found. Sep 04 16:22:12.866195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9fd8d662-5d40-4ae7-846f-3b61d7d5e1ae tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Request method failure captured: Sep 04 16:22:12.866195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/os-volumes/676900b0-0fb1-4505-a1e3-0dcfc4b11302 HTTP/1.1 Sep 04 16:22:12.866195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:22:12.866195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:22:12.866195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:22:12.866195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:22:12.866195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:22:12.866195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:22:12.866195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:22:12.866195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:22:12.866195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFNCsF4eXd9RPhstyNFQc7xek0AmLbORGvLzyNWvmFMwxa4HJpoJSt0M5-jR4m-cssY_P5Syp9w-qD3wmUJHvDylTgvTiE3mX3RPjefIpGK8c9xdyVMQ5YYrA3kg0WYJ229QTc6nAhkiFXWL7Mb8irGmvU7CQO2BySp05vtXq8tgoXxw Sep 04 16:22:12.866195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:22:12.866195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:22:12.866195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:22:12.866195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:22:12.866195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:22:12.866195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:22:12.866195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: cf5f20da263e45abb540fa062ab9aa19 Sep 04 16:22:12.866195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-531724680 Sep 04 16:22:12.866195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:22:12.866195 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:22:12.867592 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cf5f20da263e45abb540fa062ab9aa19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cf5f20da263e45abb540fa062ab9aa19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cf5f20da263e45abb540fa062ab9aa19", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cf5f20da263e45abb540fa062ab9aa19"}]}] Sep 04 16:22:12.867592 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-VolumesSnapshotsTestJSON-531724680 Sep 04 16:22:12.867592 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: cf5f20da263e45abb540fa062ab9aa19 Sep 04 16:22:12.867592 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-531724680 Sep 04 16:22:12.867592 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-VolumesSnapshotsTestJSON-531724680-project Sep 04 16:22:12.867592 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:22:12.867592 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:22:12.867592 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: 6e6309d0ca0b452f8e05632349fb17d6 Sep 04 16:22:12.867592 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-VolumesSnapshotsTestJSON-531724680-project Sep 04 16:22:12.867592 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: Sep 04 16:22:12.867592 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Volume 676900b0-0fb1-4505-a1e3-0dcfc4b11302 could not be found. Sep 04 16:22:12.867592 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': '676900b0-0fb1-4505-a1e3-0dcfc4b11302'} Sep 04 16:22:12.867592 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:22:12.868457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:12.868457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 16:22:12.868457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 16:22:12.868457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 04 16:22:12.868457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 04 16:22:12.868457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 04 16:22:12.868457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 04 16:22:12.868457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 04 16:22:12.868457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 04 16:22:12.868457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 04 16:22:12.868457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 04 16:22:12.868457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 16:22:12.868457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 16:22:12.868457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 16:22:12.868457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 16:22:12.868457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 676900b0-0fb1-4505-a1e3-0dcfc4b11302 could not be found. (HTTP 404) (Request-ID: req-e1756071-8543-409f-9107-cb81917bed0e) Sep 04 16:22:12.868457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:12.868457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:12.868457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:12.870244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:12.870244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 04 16:22:12.870244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 04 16:22:12.870244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 04 16:22:12.870244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 04 16:22:12.870244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 04 16:22:12.870244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 04 16:22:12.870244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 04 16:22:12.870244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 04 16:22:12.870244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 16:22:12.870244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 16:22:12.870244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 04 16:22:12.870244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 04 16:22:12.870244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 04 16:22:12.870244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 04 16:22:12.870244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 04 16:22:12.870244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 04 16:22:12.870244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 04 16:22:12.870244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 04 16:22:12.871410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 16:22:12.871410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 16:22:12.871410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 16:22:12.871410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 16:22:12.871410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 676900b0-0fb1-4505-a1e3-0dcfc4b11302 could not be found. Sep 04 16:22:12.871410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:12.871410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:12.871410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:12.871410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:12.871410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:22:12.871410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:22:12.871410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:22:12.871410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:22:12.871410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 04 16:22:12.871410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 04 16:22:12.871410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:22:12.871410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:22:12.871410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 04 16:22:12.871410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:22:12.873359 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 676900b0-0fb1-4505-a1e3-0dcfc4b11302 could not be found. Sep 04 16:22:12.873359 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:12.873359 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:12.873359 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:12.873359 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:12.873359 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:22:12.873359 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:22:12.873359 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:22:12.873359 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:22:12.873359 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 676900b0-0fb1-4505-a1e3-0dcfc4b11302 could not be found. Sep 04 16:22:12.873359 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:12.873359 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9fd8d662-5d40-4ae7-846f-3b61d7d5e1ae tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] Returning 404 to user: Volume 676900b0-0fb1-4505-a1e3-0dcfc4b11302 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:22:12.873359 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9fd8d662-5d40-4ae7-846f-3b61d7d5e1ae tempest-VolumesSnapshotsTestJSON-531724680 tempest-VolumesSnapshotsTestJSON-531724680-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/676900b0-0fb1-4505-a1e3-0dcfc4b11302" status: 404 len: 109 microversion: 2.1 time: 0.043320 Sep 04 16:22:12.873359 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 536/1075] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Sep 4 16:22:12 2022] GET /compute/v2.1/os-volumes/676900b0-0fb1-4505-a1e3-0dcfc4b11302 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:22:13.209694 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d30ff973-cb24-4f3e-ba4a-da5c21be5010 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:13.215085 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d30ff973-cb24-4f3e-ba4a-da5c21be5010 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:13.216640 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d30ff973-cb24-4f3e-ba4a-da5c21be5010 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:13.217126 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d30ff973-cb24-4f3e-ba4a-da5c21be5010 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:13.217586 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d30ff973-cb24-4f3e-ba4a-da5c21be5010 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:13.218347 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d30ff973-cb24-4f3e-ba4a-da5c21be5010 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:13.218849 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d30ff973-cb24-4f3e-ba4a-da5c21be5010 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:13.219326 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d30ff973-cb24-4f3e-ba4a-da5c21be5010 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:13.284255 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d30ff973-cb24-4f3e-ba4a-da5c21be5010 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:13.292073 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d30ff973-cb24-4f3e-ba4a-da5c21be5010 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1242 microversion: 2.1 time: 0.086377 Sep 04 16:22:13.292644 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 540/1076] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:13 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:14.318965 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-7bb9e9bc-ba13-40d9-b3ba-1f9760b11615 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:14.319650 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-7bb9e9bc-ba13-40d9-b3ba-1f9760b11615 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:14.327172 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7bb9e9bc-ba13-40d9-b3ba-1f9760b11615 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:14.327707 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7bb9e9bc-ba13-40d9-b3ba-1f9760b11615 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:14.328455 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7bb9e9bc-ba13-40d9-b3ba-1f9760b11615 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:14.329740 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7bb9e9bc-ba13-40d9-b3ba-1f9760b11615 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:14.330236 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7bb9e9bc-ba13-40d9-b3ba-1f9760b11615 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:14.330661 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-7bb9e9bc-ba13-40d9-b3ba-1f9760b11615 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:14.446490 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-7bb9e9bc-ba13-40d9-b3ba-1f9760b11615 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:14.457454 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-7bb9e9bc-ba13-40d9-b3ba-1f9760b11615 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1290 microversion: 2.1 time: 0.146504 Sep 04 16:22:14.458348 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 537/1077] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:14 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1290 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:15.262142 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1bb4e2b1-c326-440d-ab4e-c1f23024c600 tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] Action: 'create', calling method: .version_select at 0x7f96890adf70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-833594263", "metadata": {"Type": "work"}}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:22:15.278593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1bb4e2b1-c326-440d-ab4e-c1f23024c600 tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] Request method failure captured: Sep 04 16:22:15.278593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 04 16:22:15.278593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:22:15.278593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:22:15.278593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:22:15.278593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 121 Sep 04 16:22:15.278593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:22:15.278593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:22:15.278593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:22:15.278593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:22:15.278593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFNC3fzmsOpC4cw4AF_lHDt9ltBPRtTL28RwJ25jdHd816w9ywsroVZ11pWCjxJp4lv1xkbJ5iLjRboxATvRhDBOmFd030ru-NCpBq6FRNgX-y63KKTGpfr8CEVlfPaqEFRmtBEwckpk5MoDngDtrcm1YMLBLHRMN_KfsKA5yhf5InSU Sep 04 16:22:15.278593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:22:15.278593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:22:15.278593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:22:15.278593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:22:15.278593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:22:15.278593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:22:15.278593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: ebc32985b5fb4372b8f0764d8d5f1e4c Sep 04 16:22:15.278593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-VolumesNegativeTest-485517867 Sep 04 16:22:15.278593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:22:15.278593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:22:15.280157 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ebc32985b5fb4372b8f0764d8d5f1e4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ebc32985b5fb4372b8f0764d8d5f1e4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ebc32985b5fb4372b8f0764d8d5f1e4c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ebc32985b5fb4372b8f0764d8d5f1e4c"}]}] Sep 04 16:22:15.280157 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-VolumesNegativeTest-485517867 Sep 04 16:22:15.280157 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: ebc32985b5fb4372b8f0764d8d5f1e4c Sep 04 16:22:15.280157 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-VolumesNegativeTest-485517867 Sep 04 16:22:15.280157 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-VolumesNegativeTest-485517867-project Sep 04 16:22:15.280157 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:22:15.280157 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:22:15.280157 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: 48ebcbe7fce84a52ac085979d96e1098 Sep 04 16:22:15.280157 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-VolumesNegativeTest-485517867-project Sep 04 16:22:15.280157 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Sep 04 16:22:15.280157 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-833594263", "metadata": {"Type": "work"}}} Sep 04 16:22:15.280157 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: Sep 04 16:22:15.280157 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 04 16:22:15.282409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-833594263', 'metadata': {'Type': 'work'}}}} Sep 04 16:22:15.282409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:22:15.282409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:15.282409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 04 16:22:15.282409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 04 16:22:15.282409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 04 16:22:15.282409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise error Sep 04 16:22:15.282409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 04 16:22:15.282409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.282409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 04 16:22:15.282409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 04 16:22:15.282409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.282409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 04 16:22:15.282409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi '#$%' Sep 04 16:22:15.282409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.282409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:15.282409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.282409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:15.282409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:22:15.282409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:22:15.282409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:22:15.282409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:22:15.283872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 04 16:22:15.283872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 04 16:22:15.283872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:22:15.283872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:22:15.283872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 04 16:22:15.283872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 04 16:22:15.283872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 04 16:22:15.283872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 04 16:22:15.283872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 04 16:22:15.283872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 04 16:22:15.283872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 04 16:22:15.283872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.283872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:15.283872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.283872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:15.283872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:22:15.283872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:22:15.283872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 04 16:22:15.283872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 04 16:22:15.285167 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 04 16:22:15.285167 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.285167 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1bb4e2b1-c326-440d-ab4e-c1f23024c600 tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:22:15.285167 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1bb4e2b1-c326-440d-ab4e-c1f23024c600 tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.156272 Sep 04 16:22:15.291033 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a80f40c3-c0e9-45c1-a075-cf8f9b81d537 tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] Action: 'create', calling method: .version_select at 0x7f96892bec10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1405790651", "metadata": {"Type": "work"}}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:22:15.294975 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 541/1078] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Sep 4 16:22:15 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 04 16:22:15.296729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a80f40c3-c0e9-45c1-a075-cf8f9b81d537 tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] Request method failure captured: Sep 04 16:22:15.296729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 04 16:22:15.296729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:22:15.296729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:22:15.296729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:22:15.296729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 120 Sep 04 16:22:15.296729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:22:15.296729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:22:15.296729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:22:15.296729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:22:15.296729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFNC3fzmsOpC4cw4AF_lHDt9ltBPRtTL28RwJ25jdHd816w9ywsroVZ11pWCjxJp4lv1xkbJ5iLjRboxATvRhDBOmFd030ru-NCpBq6FRNgX-y63KKTGpfr8CEVlfPaqEFRmtBEwckpk5MoDngDtrcm1YMLBLHRMN_KfsKA5yhf5InSU Sep 04 16:22:15.296729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:22:15.296729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:22:15.296729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:22:15.296729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:22:15.296729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:22:15.296729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:22:15.296729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: ebc32985b5fb4372b8f0764d8d5f1e4c Sep 04 16:22:15.296729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-VolumesNegativeTest-485517867 Sep 04 16:22:15.296729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:22:15.296729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:22:15.309615 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ebc32985b5fb4372b8f0764d8d5f1e4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ebc32985b5fb4372b8f0764d8d5f1e4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ebc32985b5fb4372b8f0764d8d5f1e4c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ebc32985b5fb4372b8f0764d8d5f1e4c"}]}] Sep 04 16:22:15.309615 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-VolumesNegativeTest-485517867 Sep 04 16:22:15.309615 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: ebc32985b5fb4372b8f0764d8d5f1e4c Sep 04 16:22:15.309615 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-VolumesNegativeTest-485517867 Sep 04 16:22:15.309615 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-VolumesNegativeTest-485517867-project Sep 04 16:22:15.309615 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:22:15.309615 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:22:15.309615 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: 48ebcbe7fce84a52ac085979d96e1098 Sep 04 16:22:15.309615 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-VolumesNegativeTest-485517867-project Sep 04 16:22:15.309615 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Sep 04 16:22:15.309615 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1405790651", "metadata": {"Type": "work"}}} Sep 04 16:22:15.309615 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: Sep 04 16:22:15.309615 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 04 16:22:15.311408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1405790651', 'metadata': {'Type': 'work'}}}} Sep 04 16:22:15.311408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:22:15.311408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:15.311408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 04 16:22:15.311408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 04 16:22:15.311408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 04 16:22:15.311408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise error Sep 04 16:22:15.311408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 04 16:22:15.311408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.311408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 04 16:22:15.311408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 04 16:22:15.311408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.311408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 04 16:22:15.311408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi '0' Sep 04 16:22:15.311408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.311408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:15.311408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.311408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:15.311408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:22:15.311408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:22:15.311408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:22:15.311408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:22:15.315235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 04 16:22:15.315235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 04 16:22:15.315235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:22:15.315235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:22:15.315235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 04 16:22:15.315235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 04 16:22:15.315235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 04 16:22:15.315235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 04 16:22:15.315235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 04 16:22:15.315235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 04 16:22:15.315235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 04 16:22:15.315235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.315235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:15.315235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.315235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:15.315235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:22:15.315235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:22:15.315235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 04 16:22:15.315235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 04 16:22:15.317911 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 04 16:22:15.317911 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.317911 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a80f40c3-c0e9-45c1-a075-cf8f9b81d537 tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:22:15.317911 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a80f40c3-c0e9-45c1-a075-cf8f9b81d537 tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011813 Sep 04 16:22:15.317911 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 538/1079] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Sep 4 16:22:15 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 04 16:22:15.318628 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-981001b5-0b25-404d-989c-0085972b4d4f tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] Action: 'create', calling method: .version_select at 0x7f96890ed9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1296335081", "metadata": {"Type": "work"}}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:22:15.325091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-981001b5-0b25-404d-989c-0085972b4d4f tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] Request method failure captured: Sep 04 16:22:15.325091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 04 16:22:15.325091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:22:15.325091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:22:15.325091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:22:15.325091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 119 Sep 04 16:22:15.325091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:22:15.325091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:22:15.325091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:22:15.325091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:22:15.325091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFNC3fzmsOpC4cw4AF_lHDt9ltBPRtTL28RwJ25jdHd816w9ywsroVZ11pWCjxJp4lv1xkbJ5iLjRboxATvRhDBOmFd030ru-NCpBq6FRNgX-y63KKTGpfr8CEVlfPaqEFRmtBEwckpk5MoDngDtrcm1YMLBLHRMN_KfsKA5yhf5InSU Sep 04 16:22:15.325091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:22:15.325091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:22:15.325091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:22:15.325091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:22:15.325091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:22:15.325091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:22:15.325091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: ebc32985b5fb4372b8f0764d8d5f1e4c Sep 04 16:22:15.325091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-VolumesNegativeTest-485517867 Sep 04 16:22:15.325091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:22:15.325091 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:22:15.328763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ebc32985b5fb4372b8f0764d8d5f1e4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ebc32985b5fb4372b8f0764d8d5f1e4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ebc32985b5fb4372b8f0764d8d5f1e4c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ebc32985b5fb4372b8f0764d8d5f1e4c"}]}] Sep 04 16:22:15.328763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-VolumesNegativeTest-485517867 Sep 04 16:22:15.328763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: ebc32985b5fb4372b8f0764d8d5f1e4c Sep 04 16:22:15.328763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-VolumesNegativeTest-485517867 Sep 04 16:22:15.328763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-VolumesNegativeTest-485517867-project Sep 04 16:22:15.328763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:22:15.328763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:22:15.328763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: 48ebcbe7fce84a52ac085979d96e1098 Sep 04 16:22:15.328763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-VolumesNegativeTest-485517867-project Sep 04 16:22:15.328763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Sep 04 16:22:15.328763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1296335081", "metadata": {"Type": "work"}}} Sep 04 16:22:15.328763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: Sep 04 16:22:15.328763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 04 16:22:15.331027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1296335081', 'metadata': {'Type': 'work'}}}} Sep 04 16:22:15.331027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:22:15.331027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:15.331027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 04 16:22:15.331027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 04 16:22:15.331027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 04 16:22:15.331027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise error Sep 04 16:22:15.331027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 04 16:22:15.331027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.331027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 04 16:22:15.331027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 04 16:22:15.331027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.331027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 04 16:22:15.331027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi '' Sep 04 16:22:15.331027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.331027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:15.331027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.331027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:15.331027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:22:15.331027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:22:15.331027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:22:15.331027 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:22:15.334878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 04 16:22:15.334878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 04 16:22:15.334878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:22:15.334878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:22:15.334878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 04 16:22:15.334878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 04 16:22:15.334878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 04 16:22:15.334878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 04 16:22:15.334878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 04 16:22:15.334878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 04 16:22:15.334878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 04 16:22:15.334878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.334878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:15.334878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.334878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:15.334878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:22:15.334878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:22:15.334878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 04 16:22:15.334878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 04 16:22:15.337639 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 04 16:22:15.337639 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.337639 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-981001b5-0b25-404d-989c-0085972b4d4f tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:22:15.337639 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-981001b5-0b25-404d-989c-0085972b4d4f tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016086 Sep 04 16:22:15.338219 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f7a86d7e-ea46-41d3-9f45-6a53216e5f43 tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] Calling method '.version_select at 0x7f96892a63a0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:15.340734 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 542/1080] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Sep 4 16:22:15 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 04 16:22:15.370136 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-f7a86d7e-ea46-41d3-9f45-6a53216e5f43 tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] HTTP exception thrown: Volume tempest-invalid-269692208 could not be found. Sep 04 16:22:15.372227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f7a86d7e-ea46-41d3-9f45-6a53216e5f43 tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] Request method failure captured: Sep 04 16:22:15.372227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-269692208 HTTP/1.1 Sep 04 16:22:15.372227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:22:15.372227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:22:15.372227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:22:15.372227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:22:15.372227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:22:15.372227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:22:15.372227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:22:15.372227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:22:15.372227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFNC3fzmsOpC4cw4AF_lHDt9ltBPRtTL28RwJ25jdHd816w9ywsroVZ11pWCjxJp4lv1xkbJ5iLjRboxATvRhDBOmFd030ru-NCpBq6FRNgX-y63KKTGpfr8CEVlfPaqEFRmtBEwckpk5MoDngDtrcm1YMLBLHRMN_KfsKA5yhf5InSU Sep 04 16:22:15.372227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:22:15.372227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:22:15.372227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:22:15.372227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:22:15.372227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:22:15.372227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:22:15.372227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: ebc32985b5fb4372b8f0764d8d5f1e4c Sep 04 16:22:15.372227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-VolumesNegativeTest-485517867 Sep 04 16:22:15.372227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:22:15.372227 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:22:15.373883 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ebc32985b5fb4372b8f0764d8d5f1e4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ebc32985b5fb4372b8f0764d8d5f1e4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ebc32985b5fb4372b8f0764d8d5f1e4c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ebc32985b5fb4372b8f0764d8d5f1e4c"}]}] Sep 04 16:22:15.373883 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-VolumesNegativeTest-485517867 Sep 04 16:22:15.373883 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: ebc32985b5fb4372b8f0764d8d5f1e4c Sep 04 16:22:15.373883 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-VolumesNegativeTest-485517867 Sep 04 16:22:15.373883 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-VolumesNegativeTest-485517867-project Sep 04 16:22:15.373883 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:22:15.373883 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:22:15.373883 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: 48ebcbe7fce84a52ac085979d96e1098 Sep 04 16:22:15.373883 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-VolumesNegativeTest-485517867-project Sep 04 16:22:15.373883 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: Sep 04 16:22:15.373883 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Volume tempest-invalid-269692208 could not be found. Sep 04 16:22:15.373883 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': 'tempest-invalid-269692208'} Sep 04 16:22:15.373883 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:22:15.375538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:15.375538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 16:22:15.375538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 16:22:15.375538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 04 16:22:15.375538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 04 16:22:15.375538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 04 16:22:15.375538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 04 16:22:15.375538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 04 16:22:15.375538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 04 16:22:15.375538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 04 16:22:15.375538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 04 16:22:15.375538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 16:22:15.375538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 16:22:15.375538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 16:22:15.375538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 16:22:15.375538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-269692208 could not be found. (HTTP 404) (Request-ID: req-49726d16-8f94-47d5-a48a-67c5d454a660) Sep 04 16:22:15.375538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.375538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:15.375538 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.376938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:15.376938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 04 16:22:15.376938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 04 16:22:15.376938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 04 16:22:15.376938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 04 16:22:15.376938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 04 16:22:15.376938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 04 16:22:15.376938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 04 16:22:15.376938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 04 16:22:15.376938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 16:22:15.376938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 16:22:15.376938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 04 16:22:15.376938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 04 16:22:15.376938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 04 16:22:15.376938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 04 16:22:15.376938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 04 16:22:15.376938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 04 16:22:15.376938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 04 16:22:15.376938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 04 16:22:15.378628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 16:22:15.378628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 16:22:15.378628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 16:22:15.378628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 16:22:15.378628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-269692208 could not be found. Sep 04 16:22:15.378628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.378628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:15.378628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.378628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:15.378628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:22:15.378628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:22:15.378628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:22:15.378628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:22:15.378628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 04 16:22:15.378628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 04 16:22:15.378628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:22:15.378628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:22:15.378628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 04 16:22:15.378628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:22:15.378628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-269692208 could not be found. Sep 04 16:22:15.380093 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.380093 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:15.380093 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.380093 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:15.380093 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:22:15.380093 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:22:15.380093 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:22:15.380093 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:22:15.380093 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-269692208 could not be found. Sep 04 16:22:15.380093 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.383844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f7a86d7e-ea46-41d3-9f45-6a53216e5f43 tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] Returning 404 to user: Volume tempest-invalid-269692208 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:22:15.383844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f7a86d7e-ea46-41d3-9f45-6a53216e5f43 tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/tempest-invalid-269692208" status: 404 len: 98 microversion: 2.1 time: 0.050127 Sep 04 16:22:15.383844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 539/1081] 10.222.0.39 () {58 vars in 1215 bytes} [Sun Sep 4 16:22:15 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-269692208 => generated 98 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 04 16:22:15.394657 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d7a274d3-1cf2-4d4b-9b00-39db3e4b262f tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005422 Sep 04 16:22:15.395355 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 543/1082] 10.222.0.39 () {58 vars in 1140 bytes} [Sun Sep 4 16:22:15 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 04 16:22:15.405151 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-eb1ed20a-acd5-4b37-aa73-0f798eb523ff tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004257 Sep 04 16:22:15.410148 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 540/1083] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Sep 4 16:22:15 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 04 16:22:15.415514 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cb9ed151-2bab-45db-ab32-e951b4ccb452 tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] Calling method '.version_select at 0x7f96891fc160>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:15.447141 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-cb9ed151-2bab-45db-ab32-e951b4ccb452 tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] HTTP exception thrown: Volume 49c627a2-e343-43c3-8227-e7705bcf71a5 could not be found. Sep 04 16:22:15.449247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cb9ed151-2bab-45db-ab32-e951b4ccb452 tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] Request method failure captured: Sep 04 16:22:15.449247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: DELETE /compute/v2.1/os-volumes/49c627a2-e343-43c3-8227-e7705bcf71a5 HTTP/1.1 Sep 04 16:22:15.449247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:22:15.449247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:22:15.449247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:22:15.449247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 04 16:22:15.449247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:22:15.449247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:22:15.449247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:22:15.449247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:22:15.449247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFNC3fzmsOpC4cw4AF_lHDt9ltBPRtTL28RwJ25jdHd816w9ywsroVZ11pWCjxJp4lv1xkbJ5iLjRboxATvRhDBOmFd030ru-NCpBq6FRNgX-y63KKTGpfr8CEVlfPaqEFRmtBEwckpk5MoDngDtrcm1YMLBLHRMN_KfsKA5yhf5InSU Sep 04 16:22:15.449247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:22:15.449247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:22:15.449247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:22:15.449247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:22:15.449247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:22:15.449247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:22:15.449247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: ebc32985b5fb4372b8f0764d8d5f1e4c Sep 04 16:22:15.449247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-VolumesNegativeTest-485517867 Sep 04 16:22:15.449247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:22:15.449247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:22:15.450790 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ebc32985b5fb4372b8f0764d8d5f1e4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ebc32985b5fb4372b8f0764d8d5f1e4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ebc32985b5fb4372b8f0764d8d5f1e4c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ebc32985b5fb4372b8f0764d8d5f1e4c"}]}] Sep 04 16:22:15.450790 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-VolumesNegativeTest-485517867 Sep 04 16:22:15.450790 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: ebc32985b5fb4372b8f0764d8d5f1e4c Sep 04 16:22:15.450790 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-VolumesNegativeTest-485517867 Sep 04 16:22:15.450790 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-VolumesNegativeTest-485517867-project Sep 04 16:22:15.450790 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:22:15.450790 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:22:15.450790 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: 48ebcbe7fce84a52ac085979d96e1098 Sep 04 16:22:15.450790 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-VolumesNegativeTest-485517867-project Sep 04 16:22:15.450790 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: Sep 04 16:22:15.450790 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Volume 49c627a2-e343-43c3-8227-e7705bcf71a5 could not be found. Sep 04 16:22:15.450790 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'id': '49c627a2-e343-43c3-8227-e7705bcf71a5'} Sep 04 16:22:15.450790 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:22:15.457685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:15.457685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 16:22:15.457685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 16:22:15.457685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 04 16:22:15.457685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 04 16:22:15.457685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 04 16:22:15.457685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 04 16:22:15.457685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 04 16:22:15.457685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 04 16:22:15.457685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 04 16:22:15.457685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 04 16:22:15.457685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 16:22:15.457685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 16:22:15.457685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 16:22:15.457685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 16:22:15.457685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 49c627a2-e343-43c3-8227-e7705bcf71a5 could not be found. (HTTP 404) (Request-ID: req-35696441-40e0-49db-9fc9-0a57639b9482) Sep 04 16:22:15.457685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.457685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:15.457685 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.459112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:15.459112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 04 16:22:15.459112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 04 16:22:15.459112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 04 16:22:15.459112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 04 16:22:15.459112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 04 16:22:15.459112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 04 16:22:15.459112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 04 16:22:15.459112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 04 16:22:15.459112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 16:22:15.459112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 16:22:15.459112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 04 16:22:15.459112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 04 16:22:15.459112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 04 16:22:15.459112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 04 16:22:15.459112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 04 16:22:15.459112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 04 16:22:15.459112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 04 16:22:15.459112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 04 16:22:15.460373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 16:22:15.460373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 16:22:15.460373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 16:22:15.460373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 16:22:15.460373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 49c627a2-e343-43c3-8227-e7705bcf71a5 could not be found. Sep 04 16:22:15.460373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.460373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:15.460373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.460373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:15.460373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:22:15.460373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:22:15.460373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:22:15.460373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:22:15.460373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 04 16:22:15.460373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 04 16:22:15.460373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:22:15.460373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:22:15.460373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 04 16:22:15.460373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:22:15.461511 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 49c627a2-e343-43c3-8227-e7705bcf71a5 could not be found. Sep 04 16:22:15.461511 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.461511 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:15.461511 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.461511 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:15.461511 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:22:15.461511 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:22:15.461511 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:22:15.461511 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:22:15.461511 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 49c627a2-e343-43c3-8227-e7705bcf71a5 could not be found. Sep 04 16:22:15.461511 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.461511 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cb9ed151-2bab-45db-ab32-e951b4ccb452 tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] Returning 404 to user: Volume 49c627a2-e343-43c3-8227-e7705bcf71a5 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:22:15.461511 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cb9ed151-2bab-45db-ab32-e951b4ccb452 tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/49c627a2-e343-43c3-8227-e7705bcf71a5" status: 404 len: 109 microversion: 2.1 time: 0.039504 Sep 04 16:22:15.461511 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 544/1084] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Sep 4 16:22:15 2022] DELETE /compute/v2.1/os-volumes/49c627a2-e343-43c3-8227-e7705bcf71a5 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 04 16:22:15.462458 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-66c099c2-0e9a-4cbe-b39e-a6e5c2ce3e87 tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] Calling method '.version_select at 0x7f96892be310>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:15.489286 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c36fd777-194e-4623-8eb4-a148173c7224 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:15.489649 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c36fd777-194e-4623-8eb4-a148173c7224 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:15.492190 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-66c099c2-0e9a-4cbe-b39e-a6e5c2ce3e87 tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] HTTP exception thrown: Volume 4330a7bb-9327-48cb-8315-b62b52bbb598 could not be found. Sep 04 16:22:15.494392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-66c099c2-0e9a-4cbe-b39e-a6e5c2ce3e87 tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] Request method failure captured: Sep 04 16:22:15.494392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/os-volumes/4330a7bb-9327-48cb-8315-b62b52bbb598 HTTP/1.1 Sep 04 16:22:15.494392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:22:15.494392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:22:15.494392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:22:15.494392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:22:15.494392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:22:15.494392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:22:15.494392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:22:15.494392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:22:15.494392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFNC3fzmsOpC4cw4AF_lHDt9ltBPRtTL28RwJ25jdHd816w9ywsroVZ11pWCjxJp4lv1xkbJ5iLjRboxATvRhDBOmFd030ru-NCpBq6FRNgX-y63KKTGpfr8CEVlfPaqEFRmtBEwckpk5MoDngDtrcm1YMLBLHRMN_KfsKA5yhf5InSU Sep 04 16:22:15.494392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:22:15.494392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:22:15.494392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:22:15.494392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:22:15.494392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:22:15.494392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:22:15.494392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: ebc32985b5fb4372b8f0764d8d5f1e4c Sep 04 16:22:15.494392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-VolumesNegativeTest-485517867 Sep 04 16:22:15.494392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:22:15.494392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:22:15.495858 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ebc32985b5fb4372b8f0764d8d5f1e4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ebc32985b5fb4372b8f0764d8d5f1e4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ebc32985b5fb4372b8f0764d8d5f1e4c", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ebc32985b5fb4372b8f0764d8d5f1e4c"}]}] Sep 04 16:22:15.495858 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-VolumesNegativeTest-485517867 Sep 04 16:22:15.495858 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: ebc32985b5fb4372b8f0764d8d5f1e4c Sep 04 16:22:15.495858 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-VolumesNegativeTest-485517867 Sep 04 16:22:15.495858 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-VolumesNegativeTest-485517867-project Sep 04 16:22:15.495858 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:22:15.495858 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:22:15.495858 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: 48ebcbe7fce84a52ac085979d96e1098 Sep 04 16:22:15.495858 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-VolumesNegativeTest-485517867-project Sep 04 16:22:15.495858 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: Sep 04 16:22:15.495858 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Volume 4330a7bb-9327-48cb-8315-b62b52bbb598 could not be found. Sep 04 16:22:15.495858 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': '4330a7bb-9327-48cb-8315-b62b52bbb598'} Sep 04 16:22:15.495858 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:22:15.496784 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:15.496784 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 16:22:15.496784 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 16:22:15.496784 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 04 16:22:15.496784 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 04 16:22:15.496784 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 04 16:22:15.496784 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 04 16:22:15.496784 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 04 16:22:15.496784 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 04 16:22:15.496784 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 04 16:22:15.496784 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 04 16:22:15.496784 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 16:22:15.496784 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 16:22:15.496784 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 16:22:15.496784 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 16:22:15.496784 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4330a7bb-9327-48cb-8315-b62b52bbb598 could not be found. (HTTP 404) (Request-ID: req-158af305-1370-4b1e-9dbf-cb96f096be5a) Sep 04 16:22:15.496784 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.496784 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:15.496784 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.498188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:15.498188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 04 16:22:15.498188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 04 16:22:15.498188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 04 16:22:15.498188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 04 16:22:15.498188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 04 16:22:15.498188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 04 16:22:15.498188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 04 16:22:15.498188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 04 16:22:15.498188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 04 16:22:15.498188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 04 16:22:15.498188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 04 16:22:15.498188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 04 16:22:15.498188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 04 16:22:15.498188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 04 16:22:15.498188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 04 16:22:15.498188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 04 16:22:15.498188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 04 16:22:15.498188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 04 16:22:15.500100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 04 16:22:15.500100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 04 16:22:15.500100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 04 16:22:15.500100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 04 16:22:15.500100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4330a7bb-9327-48cb-8315-b62b52bbb598 could not be found. Sep 04 16:22:15.500100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.500100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:15.500100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.500100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:15.500100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:22:15.500100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:22:15.500100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:22:15.500100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:22:15.500100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 04 16:22:15.500100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 04 16:22:15.500100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:22:15.500100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:22:15.500100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 04 16:22:15.500100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:22:15.501644 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4330a7bb-9327-48cb-8315-b62b52bbb598 could not be found. Sep 04 16:22:15.501644 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.501644 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:15.501644 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.501644 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:15.501644 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:22:15.501644 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:22:15.501644 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:22:15.501644 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:22:15.501644 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4330a7bb-9327-48cb-8315-b62b52bbb598 could not be found. Sep 04 16:22:15.501644 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:15.506053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c36fd777-194e-4623-8eb4-a148173c7224 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:15.506053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c36fd777-194e-4623-8eb4-a148173c7224 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:15.506053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c36fd777-194e-4623-8eb4-a148173c7224 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:15.506053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c36fd777-194e-4623-8eb4-a148173c7224 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:15.506389 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c36fd777-194e-4623-8eb4-a148173c7224 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:15.506389 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c36fd777-194e-4623-8eb4-a148173c7224 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:15.506571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-66c099c2-0e9a-4cbe-b39e-a6e5c2ce3e87 tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] Returning 404 to user: Volume 4330a7bb-9327-48cb-8315-b62b52bbb598 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:22:15.506571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-66c099c2-0e9a-4cbe-b39e-a6e5c2ce3e87 tempest-VolumesNegativeTest-485517867 tempest-VolumesNegativeTest-485517867-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/4330a7bb-9327-48cb-8315-b62b52bbb598" status: 404 len: 109 microversion: 2.1 time: 0.045908 Sep 04 16:22:15.507162 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 541/1085] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Sep 4 16:22:15 2022] GET /compute/v2.1/os-volumes/4330a7bb-9327-48cb-8315-b62b52bbb598 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 04 16:22:15.609295 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c36fd777-194e-4623-8eb4-a148173c7224 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:15.622070 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c36fd777-194e-4623-8eb4-a148173c7224 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1296 microversion: 2.1 time: 0.137661 Sep 04 16:22:15.623095 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 545/1086] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:15 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1296 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:16.373671 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-45e3190c-de08-4809-b598-ca04bd7b10a5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:16.374223 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-45e3190c-de08-4809-b598-ca04bd7b10a5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:16.388433 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45e3190c-de08-4809-b598-ca04bd7b10a5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:16.388945 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45e3190c-de08-4809-b598-ca04bd7b10a5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:16.389402 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45e3190c-de08-4809-b598-ca04bd7b10a5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:16.390234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45e3190c-de08-4809-b598-ca04bd7b10a5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:16.390724 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45e3190c-de08-4809-b598-ca04bd7b10a5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:16.391332 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-45e3190c-de08-4809-b598-ca04bd7b10a5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:16.405546 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-936d16d0-7a71-4b7f-8feb-68072e1833f0 req-26985984-2672-40dd-85c9-343ae3c0d68d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84acd9f2-8732-4d8b-843e-46e2ccd5e5cc", "tag": "b7aa303d-deea-4135-89b8-303faf88bdfe"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:22:16.424147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-936d16d0-7a71-4b7f-8feb-68072e1833f0 req-26985984-2672-40dd-85c9-343ae3c0d68d service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:16.424629 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-936d16d0-7a71-4b7f-8feb-68072e1833f0 req-26985984-2672-40dd-85c9-343ae3c0d68d service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:16.425065 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-936d16d0-7a71-4b7f-8feb-68072e1833f0 req-26985984-2672-40dd-85c9-343ae3c0d68d service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:16.439007 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-45e3190c-de08-4809-b598-ca04bd7b10a5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 16:22:16.444340 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-936d16d0-7a71-4b7f-8feb-68072e1833f0 req-26985984-2672-40dd-85c9-343ae3c0d68d service nova] Creating event network-changed:b7aa303d-deea-4135-89b8-303faf88bdfe for instance 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc on hv-cinder-85236 Sep 04 16:22:16.449785 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-936d16d0-7a71-4b7f-8feb-68072e1833f0 req-26985984-2672-40dd-85c9-343ae3c0d68d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048527 Sep 04 16:22:16.450907 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 546/1087] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:22:16.647259 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fd719968-a6df-4094-a2d5-b0949ca02b73 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:16.648360 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fd719968-a6df-4094-a2d5-b0949ca02b73 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:16.660119 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd719968-a6df-4094-a2d5-b0949ca02b73 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:16.660941 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd719968-a6df-4094-a2d5-b0949ca02b73 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:16.661548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd719968-a6df-4094-a2d5-b0949ca02b73 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:16.664003 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd719968-a6df-4094-a2d5-b0949ca02b73 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:16.664580 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd719968-a6df-4094-a2d5-b0949ca02b73 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:16.665120 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fd719968-a6df-4094-a2d5-b0949ca02b73 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:16.741716 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-45e3190c-de08-4809-b598-ca04bd7b10a5 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "DELETE /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 204 len: 0 microversion: 2.1 time: 0.372561 Sep 04 16:22:16.743118 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 542/1088] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:22:16 2022] DELETE /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 16:22:16.752168 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a01f37f5-b2fb-4c1c-8def-1c8ba3d83fb8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:16.753415 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a01f37f5-b2fb-4c1c-8def-1c8ba3d83fb8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:16.761078 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a01f37f5-b2fb-4c1c-8def-1c8ba3d83fb8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:16.762199 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a01f37f5-b2fb-4c1c-8def-1c8ba3d83fb8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:16.762833 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a01f37f5-b2fb-4c1c-8def-1c8ba3d83fb8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:16.763761 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a01f37f5-b2fb-4c1c-8def-1c8ba3d83fb8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:16.764413 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a01f37f5-b2fb-4c1c-8def-1c8ba3d83fb8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:16.766004 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a01f37f5-b2fb-4c1c-8def-1c8ba3d83fb8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:16.970379 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-fd719968-a6df-4094-a2d5-b0949ca02b73 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:16.978960 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fd719968-a6df-4094-a2d5-b0949ca02b73 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1364 microversion: 2.1 time: 0.336347 Sep 04 16:22:16.980063 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 547/1089] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:16 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1364 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:22:17.026947 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a01f37f5-b2fb-4c1c-8def-1c8ba3d83fb8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:17.035708 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a01f37f5-b2fb-4c1c-8def-1c8ba3d83fb8 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1569 microversion: 2.1 time: 0.288323 Sep 04 16:22:17.036291 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 543/1090] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:16 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1569 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:22:17.102601 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-ef69460a-bd93-4af1-ae5c-5e89b4f8c048 req-f694dc9e-695c-41e0-97be-220e66481adc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ab95ba-6b1d-482f-9160-c25b0c3ba82b", "tag": "2ba1839b-cf90-4859-94e6-4295e7f3acba"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:22:17.115115 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ef69460a-bd93-4af1-ae5c-5e89b4f8c048 req-f694dc9e-695c-41e0-97be-220e66481adc service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:17.115608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ef69460a-bd93-4af1-ae5c-5e89b4f8c048 req-f694dc9e-695c-41e0-97be-220e66481adc service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:17.116048 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-ef69460a-bd93-4af1-ae5c-5e89b4f8c048 req-f694dc9e-695c-41e0-97be-220e66481adc service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:17.132958 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-ef69460a-bd93-4af1-ae5c-5e89b4f8c048 req-f694dc9e-695c-41e0-97be-220e66481adc service nova] Creating event network-changed:2ba1839b-cf90-4859-94e6-4295e7f3acba for instance b4ab95ba-6b1d-482f-9160-c25b0c3ba82b on hv-cinder-85236 Sep 04 16:22:17.137949 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-ef69460a-bd93-4af1-ae5c-5e89b4f8c048 req-f694dc9e-695c-41e0-97be-220e66481adc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042357 Sep 04 16:22:17.138863 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 548/1091] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:22:18.003088 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-76a00110-fef3-4f06-882e-b0089274a61e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:18.003842 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-76a00110-fef3-4f06-882e-b0089274a61e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:18.010353 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-76a00110-fef3-4f06-882e-b0089274a61e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:18.010957 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-76a00110-fef3-4f06-882e-b0089274a61e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:18.011278 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-76a00110-fef3-4f06-882e-b0089274a61e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:18.011980 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-76a00110-fef3-4f06-882e-b0089274a61e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:18.012518 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-76a00110-fef3-4f06-882e-b0089274a61e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:18.012873 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-76a00110-fef3-4f06-882e-b0089274a61e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:18.060127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-37bc3bd1-9489-4b99-a134-2f680aa952b1 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:18.060823 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-37bc3bd1-9489-4b99-a134-2f680aa952b1 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:18.068211 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37bc3bd1-9489-4b99-a134-2f680aa952b1 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:18.068698 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37bc3bd1-9489-4b99-a134-2f680aa952b1 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:18.069140 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37bc3bd1-9489-4b99-a134-2f680aa952b1 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:18.069879 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37bc3bd1-9489-4b99-a134-2f680aa952b1 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:18.070513 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37bc3bd1-9489-4b99-a134-2f680aa952b1 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:18.070940 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-37bc3bd1-9489-4b99-a134-2f680aa952b1 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:18.249509 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-76a00110-fef3-4f06-882e-b0089274a61e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:18.257769 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-76a00110-fef3-4f06-882e-b0089274a61e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1364 microversion: 2.1 time: 0.259082 Sep 04 16:22:18.258334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 544/1092] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:17 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1364 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:18.452754 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-37bc3bd1-9489-4b99-a134-2f680aa952b1 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:18.461001 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-37bc3bd1-9489-4b99-a134-2f680aa952b1 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1569 microversion: 2.1 time: 0.405065 Sep 04 16:22:18.462000 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 549/1093] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:18 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1569 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:22:19.281214 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b814622e-0f8f-4ffc-a402-6492d9d352b7 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:19.281908 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b814622e-0f8f-4ffc-a402-6492d9d352b7 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:19.287501 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-b1d9c265-b79c-4e3d-9aa0-c181c0962428 req-0d0ab37f-afd3-4603-96e4-17f49f5aa13a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84acd9f2-8732-4d8b-843e-46e2ccd5e5cc", "name": "network-vif-deleted", "tag": "b7aa303d-deea-4135-89b8-303faf88bdfe"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:22:19.290943 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b814622e-0f8f-4ffc-a402-6492d9d352b7 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:19.290943 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b814622e-0f8f-4ffc-a402-6492d9d352b7 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:19.290943 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b814622e-0f8f-4ffc-a402-6492d9d352b7 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:19.290943 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b814622e-0f8f-4ffc-a402-6492d9d352b7 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:19.291430 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b814622e-0f8f-4ffc-a402-6492d9d352b7 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:19.291430 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b814622e-0f8f-4ffc-a402-6492d9d352b7 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:19.298379 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-b1d9c265-b79c-4e3d-9aa0-c181c0962428 req-0d0ab37f-afd3-4603-96e4-17f49f5aa13a service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:19.299152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-b1d9c265-b79c-4e3d-9aa0-c181c0962428 req-0d0ab37f-afd3-4603-96e4-17f49f5aa13a service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:19.299590 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-b1d9c265-b79c-4e3d-9aa0-c181c0962428 req-0d0ab37f-afd3-4603-96e4-17f49f5aa13a service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:19.312045 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-b1d9c265-b79c-4e3d-9aa0-c181c0962428 req-0d0ab37f-afd3-4603-96e4-17f49f5aa13a service nova] Creating event network-vif-deleted:b7aa303d-deea-4135-89b8-303faf88bdfe for instance 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc on hv-cinder-85236 Sep 04 16:22:19.318360 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-b1d9c265-b79c-4e3d-9aa0-c181c0962428 req-0d0ab37f-afd3-4603-96e4-17f49f5aa13a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034584 Sep 04 16:22:19.319185 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 545/1094] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:22:19.428499 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b814622e-0f8f-4ffc-a402-6492d9d352b7 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:19.436655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b814622e-0f8f-4ffc-a402-6492d9d352b7 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1364 microversion: 2.1 time: 0.159220 Sep 04 16:22:19.437223 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 550/1095] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:19 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:19.488174 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-70e14456-ec95-4ca2-93b1-7767b282a501 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:19.488905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-70e14456-ec95-4ca2-93b1-7767b282a501 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:19.495099 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70e14456-ec95-4ca2-93b1-7767b282a501 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:19.495599 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70e14456-ec95-4ca2-93b1-7767b282a501 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:19.496036 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70e14456-ec95-4ca2-93b1-7767b282a501 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:19.496730 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70e14456-ec95-4ca2-93b1-7767b282a501 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:19.497188 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70e14456-ec95-4ca2-93b1-7767b282a501 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:19.497636 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-70e14456-ec95-4ca2-93b1-7767b282a501 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:19.563511 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-70e14456-ec95-4ca2-93b1-7767b282a501 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:19.572172 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-70e14456-ec95-4ca2-93b1-7767b282a501 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1384 microversion: 2.1 time: 0.089164 Sep 04 16:22:19.572750 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 546/1096] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:19 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1384 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:20.460597 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-cdb3e42e-7fdf-412d-b4ee-80cad26747cb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:20.461337 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-cdb3e42e-7fdf-412d-b4ee-80cad26747cb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:20.468043 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdb3e42e-7fdf-412d-b4ee-80cad26747cb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:20.468288 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdb3e42e-7fdf-412d-b4ee-80cad26747cb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:20.468717 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdb3e42e-7fdf-412d-b4ee-80cad26747cb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:20.469399 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdb3e42e-7fdf-412d-b4ee-80cad26747cb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:20.469872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdb3e42e-7fdf-412d-b4ee-80cad26747cb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:20.470289 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-cdb3e42e-7fdf-412d-b4ee-80cad26747cb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:20.596296 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3aade9d0-d766-4568-b869-9b697d52070d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:20.597482 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3aade9d0-d766-4568-b869-9b697d52070d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:20.604598 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3aade9d0-d766-4568-b869-9b697d52070d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:20.605078 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3aade9d0-d766-4568-b869-9b697d52070d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:20.605596 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3aade9d0-d766-4568-b869-9b697d52070d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:20.606533 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3aade9d0-d766-4568-b869-9b697d52070d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:20.606724 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3aade9d0-d766-4568-b869-9b697d52070d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:20.607356 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3aade9d0-d766-4568-b869-9b697d52070d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:20.629135 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-cdb3e42e-7fdf-412d-b4ee-80cad26747cb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:20.639576 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-cdb3e42e-7fdf-412d-b4ee-80cad26747cb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1364 microversion: 2.1 time: 0.182825 Sep 04 16:22:20.649947 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 551/1097] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:20 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1364 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:22:20.657159 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3aade9d0-d766-4568-b869-9b697d52070d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:20.657159 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3aade9d0-d766-4568-b869-9b697d52070d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:20.657159 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3aade9d0-d766-4568-b869-9b697d52070d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:20.657159 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-3aade9d0-d766-4568-b869-9b697d52070d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lazy-loading 'fault' on Instance uuid 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:22:20.707480 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3aade9d0-d766-4568-b869-9b697d52070d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7796ec614f2545c29c2739d3dfd889f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770dbd9183804e7fb0cbb99af75b45f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:20.716574 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3aade9d0-d766-4568-b869-9b697d52070d tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 200 len: 1225 microversion: 2.1 time: 0.124274 Sep 04 16:22:20.717162 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 547/1098] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:20 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:22:21.665036 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-53924f9d-05c2-4d83-b826-fb1e9d4abfeb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:21.665661 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-53924f9d-05c2-4d83-b826-fb1e9d4abfeb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:21.672056 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53924f9d-05c2-4d83-b826-fb1e9d4abfeb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:21.672535 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53924f9d-05c2-4d83-b826-fb1e9d4abfeb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:21.672968 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53924f9d-05c2-4d83-b826-fb1e9d4abfeb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:21.673680 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53924f9d-05c2-4d83-b826-fb1e9d4abfeb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:21.674136 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53924f9d-05c2-4d83-b826-fb1e9d4abfeb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:21.674556 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53924f9d-05c2-4d83-b826-fb1e9d4abfeb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:21.744448 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c8ac9e6c-0052-4e19-aae7-0f3f51a9ece1 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:21.745057 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c8ac9e6c-0052-4e19-aae7-0f3f51a9ece1 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] [instance: 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:21.751646 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c8ac9e6c-0052-4e19-aae7-0f3f51a9ece1 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:21.752338 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c8ac9e6c-0052-4e19-aae7-0f3f51a9ece1 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:21.752597 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c8ac9e6c-0052-4e19-aae7-0f3f51a9ece1 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:21.753311 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c8ac9e6c-0052-4e19-aae7-0f3f51a9ece1 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:21.753755 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c8ac9e6c-0052-4e19-aae7-0f3f51a9ece1 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:21.754177 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c8ac9e6c-0052-4e19-aae7-0f3f51a9ece1 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:21.768987 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-c8ac9e6c-0052-4e19-aae7-0f3f51a9ece1 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] HTTP exception thrown: Instance 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc could not be found. Sep 04 16:22:21.771216 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c8ac9e6c-0052-4e19-aae7-0f3f51a9ece1 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Request method failure captured: Sep 04 16:22:21.771216 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc HTTP/1.1 Sep 04 16:22:21.771216 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:22:21.771216 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:22:21.771216 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:22:21.771216 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:22:21.771216 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:22:21.771216 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:22:21.771216 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:22:21.771216 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:22:21.771216 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFM8nH1YF7TxC3IvNlmE07ekjSvE6mZhAfKGhpmxlOnCrMx_XCcyIffx1sq3BbxTrrw7r1MgR4rgXCAjUHhr2LtZdr-QRpkA0PrycxM8obTj6qOL4OJTbcVTnksODsGzB2UXW9r_n36Nho8J7QkEOY5hvWBvlzOkWdLd2POw6cS-x0ao Sep 04 16:22:21.771216 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:22:21.771216 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:22:21.771216 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:22:21.771216 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:22:21.771216 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:22:21.771216 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:22:21.771216 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: 770dbd9183804e7fb0cbb99af75b45f2 Sep 04 16:22:21.771216 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-TestShelveInstance-1353950557 Sep 04 16:22:21.771216 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:22:21.771216 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:22:21.772595 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/770dbd9183804e7fb0cbb99af75b45f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/770dbd9183804e7fb0cbb99af75b45f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_770dbd9183804e7fb0cbb99af75b45f2", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/770dbd9183804e7fb0cbb99af75b45f2"}]}] Sep 04 16:22:21.772595 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-TestShelveInstance-1353950557 Sep 04 16:22:21.772595 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 770dbd9183804e7fb0cbb99af75b45f2 Sep 04 16:22:21.772595 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-TestShelveInstance-1353950557 Sep 04 16:22:21.772595 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-TestShelveInstance-1353950557-project Sep 04 16:22:21.772595 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:22:21.772595 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:22:21.772595 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: 7796ec614f2545c29c2739d3dfd889f4 Sep 04 16:22:21.772595 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-TestShelveInstance-1353950557-project Sep 04 16:22:21.772595 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: > Sep 04 16:22:21.772595 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Instance 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc could not be found. Sep 04 16:22:21.772595 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': '84acd9f2-8732-4d8b-843e-46e2ccd5e5cc'} Sep 04 16:22:21.773503 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:22:21.773503 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:21.773503 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:22:21.773503 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:22:21.773503 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:22:21.773503 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:22:21.773503 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:22:21.773503 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:22:21.773503 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:22:21.773503 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:22:21.773503 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc could not be found. Sep 04 16:22:21.773503 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:21.773503 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:21.773503 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:21.773503 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:21.773503 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:22:21.773503 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:22:21.773503 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:22:21.773503 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:22:21.773503 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:22:21.775012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:22:21.775012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:22:21.775012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:22:21.775012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:22:21.775012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:22:21.775012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:22:21.775012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:22:21.775012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc could not be found. Sep 04 16:22:21.775012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:21.775012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:22:21.775012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:21.775012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:22:21.775012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:22:21.775012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:22:21.775012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:22:21.775012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:22:21.775012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc could not be found. Sep 04 16:22:21.775012 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:22:21.777973 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c8ac9e6c-0052-4e19-aae7-0f3f51a9ece1 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Returning 404 to user: Instance 84acd9f2-8732-4d8b-843e-46e2ccd5e5cc could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:22:21.779341 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c8ac9e6c-0052-4e19-aae7-0f3f51a9ece1 tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc" status: 404 len: 111 microversion: 2.1 time: 0.038336 Sep 04 16:22:21.779910 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 548/1099] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:21 2022] GET /compute/v2.1/servers/84acd9f2-8732-4d8b-843e-46e2ccd5e5cc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 04 16:22:21.829103 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-53924f9d-05c2-4d83-b826-fb1e9d4abfeb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:21.836372 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-53924f9d-05c2-4d83-b826-fb1e9d4abfeb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1364 microversion: 2.1 time: 0.175740 Sep 04 16:22:21.837233 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 552/1100] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:21 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:22.051450 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c2e6059b-5e9e-42cb-9936-075f91c80e5e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] Calling method '.version_select at 0x7f96892beca0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:22.054003 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:22:22.054783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=6 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:22:22.182452 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c2e6059b-5e9e-42cb-9936-075f91c80e5e tempest-TestShelveInstance-1353950557 tempest-TestShelveInstance-1353950557-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2067148300" status: 202 len: 0 microversion: 2.1 time: 0.134747 Sep 04 16:22:22.182452 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 549/1101] 10.222.0.39 () {58 vars in 1254 bytes} [Sun Sep 4 16:22:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2067148300 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:22:22.860099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-da1f2890-15c1-444c-99e0-d609dcaac01d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:22.860723 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-da1f2890-15c1-444c-99e0-d609dcaac01d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:22.863817 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=6 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:22:22.868981 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da1f2890-15c1-444c-99e0-d609dcaac01d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:22.869500 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da1f2890-15c1-444c-99e0-d609dcaac01d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:22.869975 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da1f2890-15c1-444c-99e0-d609dcaac01d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:22.870682 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da1f2890-15c1-444c-99e0-d609dcaac01d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:22.871136 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da1f2890-15c1-444c-99e0-d609dcaac01d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:22.871562 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da1f2890-15c1-444c-99e0-d609dcaac01d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:23.117095 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-da1f2890-15c1-444c-99e0-d609dcaac01d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:23.124828 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-da1f2890-15c1-444c-99e0-d609dcaac01d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1364 microversion: 2.1 time: 0.268740 Sep 04 16:22:23.125403 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 553/1102] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:22 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1364 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:24.014756 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-c37a17aa-cc3a-4417-b898-295288e75fdc req-7f624387-c69c-4429-b478-500ac050858e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ab95ba-6b1d-482f-9160-c25b0c3ba82b", "name": "network-vif-plugged", "status": "completed", "tag": "2ba1839b-cf90-4859-94e6-4295e7f3acba"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:22:24.027725 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-c37a17aa-cc3a-4417-b898-295288e75fdc req-7f624387-c69c-4429-b478-500ac050858e service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:24.028387 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-c37a17aa-cc3a-4417-b898-295288e75fdc req-7f624387-c69c-4429-b478-500ac050858e service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:24.028938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-c37a17aa-cc3a-4417-b898-295288e75fdc req-7f624387-c69c-4429-b478-500ac050858e service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:24.041332 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-c37a17aa-cc3a-4417-b898-295288e75fdc req-7f624387-c69c-4429-b478-500ac050858e service nova] Creating event network-vif-plugged:2ba1839b-cf90-4859-94e6-4295e7f3acba for instance b4ab95ba-6b1d-482f-9160-c25b0c3ba82b on hv-cinder-85236 Sep 04 16:22:24.046673 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-c37a17aa-cc3a-4417-b898-295288e75fdc req-7f624387-c69c-4429-b478-500ac050858e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043719 Sep 04 16:22:24.047938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 550/1103] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:22:24.161228 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-02c2042c-16c1-462a-b6bb-28ac5b12948c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:24.163030 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-02c2042c-16c1-462a-b6bb-28ac5b12948c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:24.169914 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02c2042c-16c1-462a-b6bb-28ac5b12948c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:24.170407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02c2042c-16c1-462a-b6bb-28ac5b12948c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:24.170850 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02c2042c-16c1-462a-b6bb-28ac5b12948c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:24.171590 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02c2042c-16c1-462a-b6bb-28ac5b12948c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:24.172230 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02c2042c-16c1-462a-b6bb-28ac5b12948c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:24.172658 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-02c2042c-16c1-462a-b6bb-28ac5b12948c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:24.435965 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-02c2042c-16c1-462a-b6bb-28ac5b12948c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:24.444907 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-02c2042c-16c1-462a-b6bb-28ac5b12948c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1364 microversion: 2.1 time: 0.295975 Sep 04 16:22:24.445489 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 554/1104] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:24 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1364 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:25.468025 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2f0be4a2-7a43-415b-90ef-015699287563 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:25.468895 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2f0be4a2-7a43-415b-90ef-015699287563 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:25.476282 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f0be4a2-7a43-415b-90ef-015699287563 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:25.476887 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f0be4a2-7a43-415b-90ef-015699287563 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:25.477387 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f0be4a2-7a43-415b-90ef-015699287563 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:25.478556 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f0be4a2-7a43-415b-90ef-015699287563 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:25.479236 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f0be4a2-7a43-415b-90ef-015699287563 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:25.480232 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2f0be4a2-7a43-415b-90ef-015699287563 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:25.647932 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2f0be4a2-7a43-415b-90ef-015699287563 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:25.659264 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2f0be4a2-7a43-415b-90ef-015699287563 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1364 microversion: 2.1 time: 0.195316 Sep 04 16:22:25.661966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 551/1105] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:25 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:26.684591 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1cf1c4b2-bd32-4a7b-99c4-968057be603c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:26.685152 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1cf1c4b2-bd32-4a7b-99c4-968057be603c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:26.694087 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1cf1c4b2-bd32-4a7b-99c4-968057be603c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:26.695686 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1cf1c4b2-bd32-4a7b-99c4-968057be603c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:26.696215 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1cf1c4b2-bd32-4a7b-99c4-968057be603c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:26.696842 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1cf1c4b2-bd32-4a7b-99c4-968057be603c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:26.697387 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1cf1c4b2-bd32-4a7b-99c4-968057be603c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:26.698038 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1cf1c4b2-bd32-4a7b-99c4-968057be603c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:26.945499 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1cf1c4b2-bd32-4a7b-99c4-968057be603c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:26.953493 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1cf1c4b2-bd32-4a7b-99c4-968057be603c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1549 microversion: 2.1 time: 0.272993 Sep 04 16:22:26.954127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 555/1106] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:26 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1549 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:26.976408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ec7323ac-4cfb-494c-b518-1ac37becfa33 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:26.977028 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ec7323ac-4cfb-494c-b518-1ac37becfa33 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:26.983639 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec7323ac-4cfb-494c-b518-1ac37becfa33 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:26.984196 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec7323ac-4cfb-494c-b518-1ac37becfa33 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:26.984704 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec7323ac-4cfb-494c-b518-1ac37becfa33 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:26.985466 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec7323ac-4cfb-494c-b518-1ac37becfa33 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:26.986013 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec7323ac-4cfb-494c-b518-1ac37becfa33 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:26.986563 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ec7323ac-4cfb-494c-b518-1ac37becfa33 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:27.092737 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ec7323ac-4cfb-494c-b518-1ac37becfa33 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119712 Sep 04 16:22:27.093550 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 552/1107] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Sep 4 16:22:26 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:22:28.409189 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-e244f013-6aee-4b09-ad31-b3a7182a5abd req-f91082d6-d1de-4db8-b555-a0e64fc1aba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ab95ba-6b1d-482f-9160-c25b0c3ba82b", "tag": "2ba1839b-cf90-4859-94e6-4295e7f3acba"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:22:28.424467 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e244f013-6aee-4b09-ad31-b3a7182a5abd req-f91082d6-d1de-4db8-b555-a0e64fc1aba4 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:28.424467 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e244f013-6aee-4b09-ad31-b3a7182a5abd req-f91082d6-d1de-4db8-b555-a0e64fc1aba4 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:28.424467 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e244f013-6aee-4b09-ad31-b3a7182a5abd req-f91082d6-d1de-4db8-b555-a0e64fc1aba4 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:28.438133 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-e244f013-6aee-4b09-ad31-b3a7182a5abd req-f91082d6-d1de-4db8-b555-a0e64fc1aba4 service nova] Creating event network-changed:2ba1839b-cf90-4859-94e6-4295e7f3acba for instance b4ab95ba-6b1d-482f-9160-c25b0c3ba82b on hv-cinder-85236 Sep 04 16:22:28.445141 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-e244f013-6aee-4b09-ad31-b3a7182a5abd req-f91082d6-d1de-4db8-b555-a0e64fc1aba4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039129 Sep 04 16:22:28.450344 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 556/1108] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:22:39.498625 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:22:39.505404 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:22:39.505404 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-bef4feab-b1ed-45ef-afb8-4409339140b9 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-484161740", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2049353985", "security_groups": [{"name": "tempest-secgroup-smoke-2145735453"}], "block_device_mapping_v2": [{"uuid": "264beb6e-f2a1-4541-a3c3-b6c12400d09a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2405227e-d5b0-44f1-b814-62bb7f0eb040"}]}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:22:39.617900 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-bef4feab-b1ed-45ef-afb8-4409339140b9 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] validate_networks() for [('2405227e-d5b0-44f1-b814-62bb7f0eb040', None, None, None, None, None)] {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 16:22:39.995848 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-bef4feab-b1ed-45ef-afb8-4409339140b9 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 16:22:39.996269 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-bef4feab-b1ed-45ef-afb8-4409339140b9 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 16:22:39.996771 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-bef4feab-b1ed-45ef-afb8-4409339140b9 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 16:22:39.997173 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-bef4feab-b1ed-45ef-afb8-4409339140b9 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 16:22:39.997594 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-bef4feab-b1ed-45ef-afb8-4409339140b9 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 16:22:40.006660 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bef4feab-b1ed-45ef-afb8-4409339140b9 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:40.007210 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bef4feab-b1ed-45ef-afb8-4409339140b9 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:40.007744 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bef4feab-b1ed-45ef-afb8-4409339140b9 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:40.008462 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bef4feab-b1ed-45ef-afb8-4409339140b9 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:40.008908 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bef4feab-b1ed-45ef-afb8-4409339140b9 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:40.009466 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bef4feab-b1ed-45ef-afb8-4409339140b9 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:40.027517 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-bef4feab-b1ed-45ef-afb8-4409339140b9 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Getting quotas for project 56e82ba24a474557af758826743136d9. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:22:40.031501 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-bef4feab-b1ed-45ef-afb8-4409339140b9 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Getting quotas for user b694f1163ef54b82b86e06bf825c57e4 and project 56e82ba24a474557af758826743136d9. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:22:40.089372 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-bef4feab-b1ed-45ef-afb8-4409339140b9 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 16:22:40.091522 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-bef4feab-b1ed-45ef-afb8-4409339140b9 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 54897af3-bad2-4c84-abce-d028c776b4df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='264beb6e-f2a1-4541-a3c3-b6c12400d09a',volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 16:22:40.533382 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-bef4feab-b1ed-45ef-afb8-4409339140b9 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.036406 Sep 04 16:22:40.544451 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 553/1109] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Sep 4 16:22:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 16:22:40.550472 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-0eec13d2-7592-474d-b040-b8810f6817f2 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:40.551540 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-0eec13d2-7592-474d-b040-b8810f6817f2 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 54897af3-bad2-4c84-abce-d028c776b4df] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:40.559684 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:22:40.560529 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=66 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:22:40.617925 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-0eec13d2-7592-474d-b040-b8810f6817f2 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:40.629545 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-0eec13d2-7592-474d-b040-b8810f6817f2 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df" status: 200 len: 1094 microversion: 2.1 time: 0.085574 Sep 04 16:22:40.636132 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 557/1110] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:40 2022] GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:41.657135 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3e82cc10-be16-4d7c-8853-4d898a85832f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:41.657777 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3e82cc10-be16-4d7c-8853-4d898a85832f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 54897af3-bad2-4c84-abce-d028c776b4df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:41.664914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e82cc10-be16-4d7c-8853-4d898a85832f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:41.665396 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e82cc10-be16-4d7c-8853-4d898a85832f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:41.665947 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e82cc10-be16-4d7c-8853-4d898a85832f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:41.666638 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e82cc10-be16-4d7c-8853-4d898a85832f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:41.667090 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e82cc10-be16-4d7c-8853-4d898a85832f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:41.667516 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3e82cc10-be16-4d7c-8853-4d898a85832f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:41.730043 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3e82cc10-be16-4d7c-8853-4d898a85832f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:41.737837 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3e82cc10-be16-4d7c-8853-4d898a85832f tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df" status: 200 len: 1144 microversion: 2.1 time: 0.085408 Sep 04 16:22:41.738404 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 554/1111] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:41 2022] GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:42.762902 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-56f03c1c-5f39-4099-84d0-6ad07a90f951 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:42.764262 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-56f03c1c-5f39-4099-84d0-6ad07a90f951 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 54897af3-bad2-4c84-abce-d028c776b4df] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:42.773266 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56f03c1c-5f39-4099-84d0-6ad07a90f951 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:42.774153 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56f03c1c-5f39-4099-84d0-6ad07a90f951 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:42.774863 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56f03c1c-5f39-4099-84d0-6ad07a90f951 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:42.776142 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56f03c1c-5f39-4099-84d0-6ad07a90f951 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:42.776851 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56f03c1c-5f39-4099-84d0-6ad07a90f951 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:42.777678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-56f03c1c-5f39-4099-84d0-6ad07a90f951 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:42.848137 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-56f03c1c-5f39-4099-84d0-6ad07a90f951 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:42.853433 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-56f03c1c-5f39-4099-84d0-6ad07a90f951 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df" status: 200 len: 1200 microversion: 2.1 time: 0.095998 Sep 04 16:22:42.854368 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 558/1112] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:42 2022] GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df => generated 1200 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:43.876500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-dce8928c-ffa2-4434-83b6-7b1bf3599870 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:43.877084 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-dce8928c-ffa2-4434-83b6-7b1bf3599870 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 54897af3-bad2-4c84-abce-d028c776b4df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:43.884699 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dce8928c-ffa2-4434-83b6-7b1bf3599870 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:43.885220 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dce8928c-ffa2-4434-83b6-7b1bf3599870 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:43.885702 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dce8928c-ffa2-4434-83b6-7b1bf3599870 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:43.886405 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dce8928c-ffa2-4434-83b6-7b1bf3599870 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:43.886855 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dce8928c-ffa2-4434-83b6-7b1bf3599870 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:43.887279 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dce8928c-ffa2-4434-83b6-7b1bf3599870 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:44.125539 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-dce8928c-ffa2-4434-83b6-7b1bf3599870 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:44.139494 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-dce8928c-ffa2-4434-83b6-7b1bf3599870 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df" status: 200 len: 1278 microversion: 2.1 time: 0.265846 Sep 04 16:22:44.153515 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 555/1113] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:43 2022] GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df => generated 1278 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:44.347476 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-49086ced-dec7-4a58-9538-b9af178b5fd7 req-7d2a433a-75fb-4b66-bc7a-a4b858d84638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54897af3-bad2-4c84-abce-d028c776b4df", "tag": "02822348-6b65-43f9-869f-901847ad94e2"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:22:44.358269 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-49086ced-dec7-4a58-9538-b9af178b5fd7 req-7d2a433a-75fb-4b66-bc7a-a4b858d84638 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:44.358744 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-49086ced-dec7-4a58-9538-b9af178b5fd7 req-7d2a433a-75fb-4b66-bc7a-a4b858d84638 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:44.359166 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-49086ced-dec7-4a58-9538-b9af178b5fd7 req-7d2a433a-75fb-4b66-bc7a-a4b858d84638 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:44.370479 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-49086ced-dec7-4a58-9538-b9af178b5fd7 req-7d2a433a-75fb-4b66-bc7a-a4b858d84638 service nova] Creating event network-changed:02822348-6b65-43f9-869f-901847ad94e2 for instance 54897af3-bad2-4c84-abce-d028c776b4df on hv-cinder-85236 Sep 04 16:22:44.375600 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-49086ced-dec7-4a58-9538-b9af178b5fd7 req-7d2a433a-75fb-4b66-bc7a-a4b858d84638 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031895 Sep 04 16:22:44.376206 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 559/1114] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:22:45.172627 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a79aaf2f-b98e-4da1-8a6f-32ec343918a8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:45.173245 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a79aaf2f-b98e-4da1-8a6f-32ec343918a8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 54897af3-bad2-4c84-abce-d028c776b4df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:45.179842 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a79aaf2f-b98e-4da1-8a6f-32ec343918a8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:45.180315 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a79aaf2f-b98e-4da1-8a6f-32ec343918a8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:45.180891 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a79aaf2f-b98e-4da1-8a6f-32ec343918a8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:45.181593 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a79aaf2f-b98e-4da1-8a6f-32ec343918a8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:45.182152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a79aaf2f-b98e-4da1-8a6f-32ec343918a8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:45.182572 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a79aaf2f-b98e-4da1-8a6f-32ec343918a8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:45.311603 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a79aaf2f-b98e-4da1-8a6f-32ec343918a8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:45.319484 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a79aaf2f-b98e-4da1-8a6f-32ec343918a8 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df" status: 200 len: 1266 microversion: 2.1 time: 0.150737 Sep 04 16:22:45.320059 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 556/1115] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:45 2022] GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:46.344374 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-67c106f6-e99a-44bf-a463-c15822a9a94d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:46.345072 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-67c106f6-e99a-44bf-a463-c15822a9a94d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 54897af3-bad2-4c84-abce-d028c776b4df] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:46.351169 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67c106f6-e99a-44bf-a463-c15822a9a94d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:46.351652 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67c106f6-e99a-44bf-a463-c15822a9a94d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:46.352081 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67c106f6-e99a-44bf-a463-c15822a9a94d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:46.352766 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67c106f6-e99a-44bf-a463-c15822a9a94d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:46.353218 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67c106f6-e99a-44bf-a463-c15822a9a94d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:46.353843 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-67c106f6-e99a-44bf-a463-c15822a9a94d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:46.501537 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-67c106f6-e99a-44bf-a463-c15822a9a94d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:46.509704 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-67c106f6-e99a-44bf-a463-c15822a9a94d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df" status: 200 len: 1266 microversion: 2.1 time: 0.170103 Sep 04 16:22:46.510535 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 560/1116] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:46 2022] GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:47.534871 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ea960e46-ee25-4a72-906e-fd6e0fd6fbc4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:47.535585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ea960e46-ee25-4a72-906e-fd6e0fd6fbc4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 54897af3-bad2-4c84-abce-d028c776b4df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:47.542282 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ea960e46-ee25-4a72-906e-fd6e0fd6fbc4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:47.544167 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ea960e46-ee25-4a72-906e-fd6e0fd6fbc4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:47.544167 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ea960e46-ee25-4a72-906e-fd6e0fd6fbc4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:47.544167 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ea960e46-ee25-4a72-906e-fd6e0fd6fbc4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:47.544519 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ea960e46-ee25-4a72-906e-fd6e0fd6fbc4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:47.544921 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ea960e46-ee25-4a72-906e-fd6e0fd6fbc4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:47.676036 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ea960e46-ee25-4a72-906e-fd6e0fd6fbc4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:47.684421 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ea960e46-ee25-4a72-906e-fd6e0fd6fbc4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df" status: 200 len: 1266 microversion: 2.1 time: 0.155298 Sep 04 16:22:47.684984 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 557/1117] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:47 2022] GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:48.706382 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-73e30343-8f59-4813-b1b9-fd1b61b53ca5 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:48.706993 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-73e30343-8f59-4813-b1b9-fd1b61b53ca5 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 54897af3-bad2-4c84-abce-d028c776b4df] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:48.713299 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-73e30343-8f59-4813-b1b9-fd1b61b53ca5 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:48.713815 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-73e30343-8f59-4813-b1b9-fd1b61b53ca5 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:48.714250 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-73e30343-8f59-4813-b1b9-fd1b61b53ca5 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:48.715600 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-73e30343-8f59-4813-b1b9-fd1b61b53ca5 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:48.716247 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-73e30343-8f59-4813-b1b9-fd1b61b53ca5 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:48.716676 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-73e30343-8f59-4813-b1b9-fd1b61b53ca5 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:48.846602 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-73e30343-8f59-4813-b1b9-fd1b61b53ca5 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:48.854599 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-73e30343-8f59-4813-b1b9-fd1b61b53ca5 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df" status: 200 len: 1266 microversion: 2.1 time: 0.152336 Sep 04 16:22:48.855514 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 561/1118] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:48 2022] GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:49.878203 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ee22eef0-f83a-4927-ac5c-7238a9ec27e4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:49.878838 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ee22eef0-f83a-4927-ac5c-7238a9ec27e4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 54897af3-bad2-4c84-abce-d028c776b4df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:49.885348 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ee22eef0-f83a-4927-ac5c-7238a9ec27e4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:49.885854 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ee22eef0-f83a-4927-ac5c-7238a9ec27e4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:49.886286 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ee22eef0-f83a-4927-ac5c-7238a9ec27e4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:49.887417 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ee22eef0-f83a-4927-ac5c-7238a9ec27e4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:49.887870 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ee22eef0-f83a-4927-ac5c-7238a9ec27e4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:49.888293 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ee22eef0-f83a-4927-ac5c-7238a9ec27e4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:50.017914 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:22:50.022021 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-ee22eef0-f83a-4927-ac5c-7238a9ec27e4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:50.033997 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ee22eef0-f83a-4927-ac5c-7238a9ec27e4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df" status: 200 len: 1266 microversion: 2.1 time: 0.159576 Sep 04 16:22:50.034598 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 558/1119] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:49 2022] GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:51.058028 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-3d9a961f-8004-4c53-ba5b-43424b21fac4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:51.059144 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-3d9a961f-8004-4c53-ba5b-43424b21fac4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 54897af3-bad2-4c84-abce-d028c776b4df] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:51.063373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:22:51.068144 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d9a961f-8004-4c53-ba5b-43424b21fac4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:51.068620 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d9a961f-8004-4c53-ba5b-43424b21fac4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:51.069049 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d9a961f-8004-4c53-ba5b-43424b21fac4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:51.069844 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d9a961f-8004-4c53-ba5b-43424b21fac4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:51.070296 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d9a961f-8004-4c53-ba5b-43424b21fac4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:51.070712 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-3d9a961f-8004-4c53-ba5b-43424b21fac4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:51.209294 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-3d9a961f-8004-4c53-ba5b-43424b21fac4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:51.217023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-3d9a961f-8004-4c53-ba5b-43424b21fac4 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df" status: 200 len: 1266 microversion: 2.1 time: 0.163278 Sep 04 16:22:51.217609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 562/1120] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:51 2022] GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:52.239163 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-66a3c6e5-8a66-4ef1-b75c-82099414e8ca tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:52.239690 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-66a3c6e5-8a66-4ef1-b75c-82099414e8ca tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 54897af3-bad2-4c84-abce-d028c776b4df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:52.241960 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=6 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:22:52.247889 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66a3c6e5-8a66-4ef1-b75c-82099414e8ca tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:52.248366 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66a3c6e5-8a66-4ef1-b75c-82099414e8ca tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:52.248803 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66a3c6e5-8a66-4ef1-b75c-82099414e8ca tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:52.249497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66a3c6e5-8a66-4ef1-b75c-82099414e8ca tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:52.249983 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66a3c6e5-8a66-4ef1-b75c-82099414e8ca tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:52.250409 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66a3c6e5-8a66-4ef1-b75c-82099414e8ca tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:52.396525 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-66a3c6e5-8a66-4ef1-b75c-82099414e8ca tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:52.405360 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-66a3c6e5-8a66-4ef1-b75c-82099414e8ca tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df" status: 200 len: 1266 microversion: 2.1 time: 0.170094 Sep 04 16:22:52.405969 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 559/1121] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:52 2022] GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:53.428267 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7ab96b35-d48f-474a-94f9-dae0779cdc70 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:53.428883 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7ab96b35-d48f-474a-94f9-dae0779cdc70 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 54897af3-bad2-4c84-abce-d028c776b4df] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:53.436283 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ab96b35-d48f-474a-94f9-dae0779cdc70 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:53.436773 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ab96b35-d48f-474a-94f9-dae0779cdc70 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:53.437249 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ab96b35-d48f-474a-94f9-dae0779cdc70 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:53.437980 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ab96b35-d48f-474a-94f9-dae0779cdc70 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:53.438438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ab96b35-d48f-474a-94f9-dae0779cdc70 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:53.438863 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7ab96b35-d48f-474a-94f9-dae0779cdc70 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:53.573281 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7ab96b35-d48f-474a-94f9-dae0779cdc70 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:53.581958 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7ab96b35-d48f-474a-94f9-dae0779cdc70 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df" status: 200 len: 1266 microversion: 2.1 time: 0.157627 Sep 04 16:22:53.582519 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 563/1122] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:53 2022] GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:54.250501 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-f4385c87-1faa-4849-801e-f8bbda2a72e9 req-6c972e4f-8135-4fef-abe2-896bdce2341c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54897af3-bad2-4c84-abce-d028c776b4df", "name": "network-vif-plugged", "status": "completed", "tag": "02822348-6b65-43f9-869f-901847ad94e2"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:22:54.262481 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-f4385c87-1faa-4849-801e-f8bbda2a72e9 req-6c972e4f-8135-4fef-abe2-896bdce2341c service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:54.262953 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-f4385c87-1faa-4849-801e-f8bbda2a72e9 req-6c972e4f-8135-4fef-abe2-896bdce2341c service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:54.263377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-f4385c87-1faa-4849-801e-f8bbda2a72e9 req-6c972e4f-8135-4fef-abe2-896bdce2341c service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:54.274843 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-f4385c87-1faa-4849-801e-f8bbda2a72e9 req-6c972e4f-8135-4fef-abe2-896bdce2341c service nova] Creating event network-vif-plugged:02822348-6b65-43f9-869f-901847ad94e2 for instance 54897af3-bad2-4c84-abce-d028c776b4df on hv-cinder-85236 Sep 04 16:22:54.280661 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-f4385c87-1faa-4849-801e-f8bbda2a72e9 req-6c972e4f-8135-4fef-abe2-896bdce2341c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034643 Sep 04 16:22:54.281240 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 560/1123] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:22:54.605051 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f9dfbe10-b169-4f74-8971-77ae408efb83 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:54.605822 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f9dfbe10-b169-4f74-8971-77ae408efb83 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 54897af3-bad2-4c84-abce-d028c776b4df] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:54.612281 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9dfbe10-b169-4f74-8971-77ae408efb83 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:54.612765 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9dfbe10-b169-4f74-8971-77ae408efb83 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:54.613197 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9dfbe10-b169-4f74-8971-77ae408efb83 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:54.613913 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9dfbe10-b169-4f74-8971-77ae408efb83 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:54.614363 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9dfbe10-b169-4f74-8971-77ae408efb83 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:54.618102 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f9dfbe10-b169-4f74-8971-77ae408efb83 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:54.750196 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f9dfbe10-b169-4f74-8971-77ae408efb83 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:54.758136 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f9dfbe10-b169-4f74-8971-77ae408efb83 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df" status: 200 len: 1266 microversion: 2.1 time: 0.157017 Sep 04 16:22:54.758701 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 564/1124] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:54 2022] GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:55.783684 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1fc41e5a-32b4-489e-ad68-18c5af87dcbb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:55.784373 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1fc41e5a-32b4-489e-ad68-18c5af87dcbb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 54897af3-bad2-4c84-abce-d028c776b4df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:55.790376 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1fc41e5a-32b4-489e-ad68-18c5af87dcbb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:55.790853 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1fc41e5a-32b4-489e-ad68-18c5af87dcbb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:55.791279 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1fc41e5a-32b4-489e-ad68-18c5af87dcbb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:55.791965 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1fc41e5a-32b4-489e-ad68-18c5af87dcbb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:55.792410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1fc41e5a-32b4-489e-ad68-18c5af87dcbb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:55.793600 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1fc41e5a-32b4-489e-ad68-18c5af87dcbb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:55.927979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1fc41e5a-32b4-489e-ad68-18c5af87dcbb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:55.935769 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1fc41e5a-32b4-489e-ad68-18c5af87dcbb tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df" status: 200 len: 1266 microversion: 2.1 time: 0.156756 Sep 04 16:22:55.936339 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 561/1125] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:55 2022] GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:56.958962 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-90ab9b95-9fa7-4427-b963-d30ae3e67d2d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:56.959567 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-90ab9b95-9fa7-4427-b963-d30ae3e67d2d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 54897af3-bad2-4c84-abce-d028c776b4df] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:56.966940 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90ab9b95-9fa7-4427-b963-d30ae3e67d2d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:56.967421 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90ab9b95-9fa7-4427-b963-d30ae3e67d2d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:56.967852 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90ab9b95-9fa7-4427-b963-d30ae3e67d2d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:56.968533 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90ab9b95-9fa7-4427-b963-d30ae3e67d2d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:56.968985 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90ab9b95-9fa7-4427-b963-d30ae3e67d2d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:56.969403 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-90ab9b95-9fa7-4427-b963-d30ae3e67d2d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:57.097796 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-90ab9b95-9fa7-4427-b963-d30ae3e67d2d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:57.105647 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-90ab9b95-9fa7-4427-b963-d30ae3e67d2d tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df" status: 200 len: 1451 microversion: 2.1 time: 0.150403 Sep 04 16:22:57.106253 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 565/1126] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:56 2022] GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:57.127851 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-23c52180-85fb-41f0-8a09-7d0e07cd0e69 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:22:57.128475 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-23c52180-85fb-41f0-8a09-7d0e07cd0e69 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 54897af3-bad2-4c84-abce-d028c776b4df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:22:57.134986 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-23c52180-85fb-41f0-8a09-7d0e07cd0e69 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:57.135469 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-23c52180-85fb-41f0-8a09-7d0e07cd0e69 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:57.135910 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-23c52180-85fb-41f0-8a09-7d0e07cd0e69 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:57.137299 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-23c52180-85fb-41f0-8a09-7d0e07cd0e69 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:57.137848 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-23c52180-85fb-41f0-8a09-7d0e07cd0e69 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:57.138282 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-23c52180-85fb-41f0-8a09-7d0e07cd0e69 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:57.270241 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-23c52180-85fb-41f0-8a09-7d0e07cd0e69 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:22:57.278197 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-23c52180-85fb-41f0-8a09-7d0e07cd0e69 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df" status: 200 len: 1451 microversion: 2.1 time: 0.153975 Sep 04 16:22:57.278769 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 562/1127] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:22:57 2022] GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:22:59.459600 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-6cc43b38-e714-4731-b3af-29e60b0bc9e5 req-2ec3477a-66f0-4da4-98fe-8d73e7b6cac4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54897af3-bad2-4c84-abce-d028c776b4df", "tag": "02822348-6b65-43f9-869f-901847ad94e2"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:22:59.480603 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6cc43b38-e714-4731-b3af-29e60b0bc9e5 req-2ec3477a-66f0-4da4-98fe-8d73e7b6cac4 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:22:59.485217 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6cc43b38-e714-4731-b3af-29e60b0bc9e5 req-2ec3477a-66f0-4da4-98fe-8d73e7b6cac4 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:22:59.485217 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-6cc43b38-e714-4731-b3af-29e60b0bc9e5 req-2ec3477a-66f0-4da4-98fe-8d73e7b6cac4 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:22:59.494099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-6cc43b38-e714-4731-b3af-29e60b0bc9e5 req-2ec3477a-66f0-4da4-98fe-8d73e7b6cac4 service nova] Creating event network-changed:02822348-6b65-43f9-869f-901847ad94e2 for instance 54897af3-bad2-4c84-abce-d028c776b4df on hv-cinder-85236 Sep 04 16:22:59.500780 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-6cc43b38-e714-4731-b3af-29e60b0bc9e5 req-2ec3477a-66f0-4da4-98fe-8d73e7b6cac4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045184 Sep 04 16:22:59.501740 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 566/1128] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:23:04.745102 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-29af57c1-9196-46d6-a63f-41aa1141c2fc tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:23:04.745726 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-29af57c1-9196-46d6-a63f-41aa1141c2fc tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:23:04.753343 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29af57c1-9196-46d6-a63f-41aa1141c2fc tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:04.754983 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29af57c1-9196-46d6-a63f-41aa1141c2fc tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:04.754983 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29af57c1-9196-46d6-a63f-41aa1141c2fc tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:04.754983 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29af57c1-9196-46d6-a63f-41aa1141c2fc tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:04.755450 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29af57c1-9196-46d6-a63f-41aa1141c2fc tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:04.755876 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-29af57c1-9196-46d6-a63f-41aa1141c2fc tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:04.780487 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-29af57c1-9196-46d6-a63f-41aa1141c2fc tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b/ips" status: 200 len: 145 microversion: 2.1 time: 0.039305 Sep 04 16:23:04.781066 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 563/1129] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Sep 4 16:23:04 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:23:07.149846 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-75361b4c-2fc5-44da-9d47-7bf3cf100654 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1254bd59-1fe8-4112-8107-87febf225cab"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:23:07.152047 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-75361b4c-2fc5-44da-9d47-7bf3cf100654 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:23:07.159392 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75361b4c-2fc5-44da-9d47-7bf3cf100654 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:07.159886 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75361b4c-2fc5-44da-9d47-7bf3cf100654 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:07.160316 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75361b4c-2fc5-44da-9d47-7bf3cf100654 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:07.161009 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75361b4c-2fc5-44da-9d47-7bf3cf100654 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:07.161463 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75361b4c-2fc5-44da-9d47-7bf3cf100654 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:07.161914 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-75361b4c-2fc5-44da-9d47-7bf3cf100654 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:07.951288 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-75361b4c-2fc5-44da-9d47-7bf3cf100654 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "POST /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.805634 Sep 04 16:23:07.951905 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 567/1130] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Sep 4 16:23:07 2022] POST /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b/os-volume_attachments => generated 194 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:23:15.500262 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-0288b7e8-0527-47ea-b3f1-b7392684c466 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:23:15.503008 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:23:15.503654 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=56 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:23:15.509061 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0288b7e8-0527-47ea-b3f1-b7392684c466 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:15.511622 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0288b7e8-0527-47ea-b3f1-b7392684c466 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:15.511622 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-0288b7e8-0527-47ea-b3f1-b7392684c466 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:15.570938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-0288b7e8-0527-47ea-b3f1-b7392684c466 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Going to try to stop instance {{(pid=121041) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 04 16:23:15.758958 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-0288b7e8-0527-47ea-b3f1-b7392684c466 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "POST /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b/action" status: 202 len: 0 microversion: 2.1 time: 0.262561 Sep 04 16:23:15.759586 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 564/1131] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Sep 4 16:23:15 2022] POST /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:23:15.769477 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2106d070-a8d7-496c-b36d-338953c77b64 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:23:15.770515 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2106d070-a8d7-496c-b36d-338953c77b64 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:23:15.772951 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=25 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:23:15.779034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2106d070-a8d7-496c-b36d-338953c77b64 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:15.779562 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2106d070-a8d7-496c-b36d-338953c77b64 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:15.780098 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2106d070-a8d7-496c-b36d-338953c77b64 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:15.780861 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2106d070-a8d7-496c-b36d-338953c77b64 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:15.781611 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2106d070-a8d7-496c-b36d-338953c77b64 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:15.782337 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2106d070-a8d7-496c-b36d-338953c77b64 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:15.790809 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:23:15.930893 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2106d070-a8d7-496c-b36d-338953c77b64 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:23:15.939143 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2106d070-a8d7-496c-b36d-338953c77b64 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1724 microversion: 2.1 time: 0.175083 Sep 04 16:23:15.939707 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 568/1132] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:23:15 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:23:16.964355 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-22197fff-05a0-476b-a122-029e1eca4d8d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:23:16.965117 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-22197fff-05a0-476b-a122-029e1eca4d8d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:23:16.971238 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-22197fff-05a0-476b-a122-029e1eca4d8d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:16.971712 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-22197fff-05a0-476b-a122-029e1eca4d8d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:16.972142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-22197fff-05a0-476b-a122-029e1eca4d8d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:16.972818 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-22197fff-05a0-476b-a122-029e1eca4d8d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:16.973827 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-22197fff-05a0-476b-a122-029e1eca4d8d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:16.974248 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-22197fff-05a0-476b-a122-029e1eca4d8d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:17.105290 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-22197fff-05a0-476b-a122-029e1eca4d8d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:23:17.113611 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-22197fff-05a0-476b-a122-029e1eca4d8d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1724 microversion: 2.1 time: 0.153824 Sep 04 16:23:17.114686 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 565/1133] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:23:16 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:23:18.136461 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-4c7e7c27-81c8-428c-8262-99baf0b27a52 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:23:18.137006 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-4c7e7c27-81c8-428c-8262-99baf0b27a52 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:23:18.144152 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c7e7c27-81c8-428c-8262-99baf0b27a52 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:18.144632 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c7e7c27-81c8-428c-8262-99baf0b27a52 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:18.146285 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c7e7c27-81c8-428c-8262-99baf0b27a52 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:18.146980 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c7e7c27-81c8-428c-8262-99baf0b27a52 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:18.147446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c7e7c27-81c8-428c-8262-99baf0b27a52 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:18.147872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-4c7e7c27-81c8-428c-8262-99baf0b27a52 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:18.284637 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-4c7e7c27-81c8-428c-8262-99baf0b27a52 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:23:18.293152 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-4c7e7c27-81c8-428c-8262-99baf0b27a52 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1724 microversion: 2.1 time: 0.160665 Sep 04 16:23:18.293880 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 569/1134] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:23:18 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:23:19.316260 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e3699d6d-b1ba-40e6-a5b8-4fa483fd3b6c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:23:19.317038 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e3699d6d-b1ba-40e6-a5b8-4fa483fd3b6c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:23:19.323630 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e3699d6d-b1ba-40e6-a5b8-4fa483fd3b6c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:19.324114 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e3699d6d-b1ba-40e6-a5b8-4fa483fd3b6c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:19.324545 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e3699d6d-b1ba-40e6-a5b8-4fa483fd3b6c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:19.325371 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e3699d6d-b1ba-40e6-a5b8-4fa483fd3b6c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:19.325849 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e3699d6d-b1ba-40e6-a5b8-4fa483fd3b6c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:19.326274 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e3699d6d-b1ba-40e6-a5b8-4fa483fd3b6c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:19.453262 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e3699d6d-b1ba-40e6-a5b8-4fa483fd3b6c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:23:19.462369 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e3699d6d-b1ba-40e6-a5b8-4fa483fd3b6c tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1724 microversion: 2.1 time: 0.149916 Sep 04 16:23:19.462941 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 566/1135] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:23:19 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:23:20.486076 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-140ba3ff-b900-47d9-9490-6a343ca70be5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:23:20.486678 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-140ba3ff-b900-47d9-9490-6a343ca70be5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:23:20.493472 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-140ba3ff-b900-47d9-9490-6a343ca70be5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:20.493989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-140ba3ff-b900-47d9-9490-6a343ca70be5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:20.494427 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-140ba3ff-b900-47d9-9490-6a343ca70be5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:20.495141 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-140ba3ff-b900-47d9-9490-6a343ca70be5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:20.495576 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-140ba3ff-b900-47d9-9490-6a343ca70be5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:20.495997 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-140ba3ff-b900-47d9-9490-6a343ca70be5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:20.628532 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-140ba3ff-b900-47d9-9490-6a343ca70be5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:23:20.637147 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-140ba3ff-b900-47d9-9490-6a343ca70be5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1724 microversion: 2.1 time: 0.155025 Sep 04 16:23:20.637728 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 570/1136] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:23:20 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:23:21.665870 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1da6b6c5-d60e-466a-9a80-e3cae6cb1660 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:23:21.666442 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1da6b6c5-d60e-466a-9a80-e3cae6cb1660 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:23:21.672678 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1da6b6c5-d60e-466a-9a80-e3cae6cb1660 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:21.673149 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1da6b6c5-d60e-466a-9a80-e3cae6cb1660 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:21.673587 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1da6b6c5-d60e-466a-9a80-e3cae6cb1660 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:21.674274 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1da6b6c5-d60e-466a-9a80-e3cae6cb1660 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:21.674725 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1da6b6c5-d60e-466a-9a80-e3cae6cb1660 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:21.675152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-1da6b6c5-d60e-466a-9a80-e3cae6cb1660 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:21.814647 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1da6b6c5-d60e-466a-9a80-e3cae6cb1660 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:23:21.823521 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1da6b6c5-d60e-466a-9a80-e3cae6cb1660 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1724 microversion: 2.1 time: 0.161673 Sep 04 16:23:21.824092 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 567/1137] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:23:21 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:23:22.846070 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-877ec3bd-09eb-43ed-af66-7f19c4209bee tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:23:22.846679 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-877ec3bd-09eb-43ed-af66-7f19c4209bee tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:23:22.853241 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-877ec3bd-09eb-43ed-af66-7f19c4209bee tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:22.853747 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-877ec3bd-09eb-43ed-af66-7f19c4209bee tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:22.854181 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-877ec3bd-09eb-43ed-af66-7f19c4209bee tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:22.854871 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-877ec3bd-09eb-43ed-af66-7f19c4209bee tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:22.855318 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-877ec3bd-09eb-43ed-af66-7f19c4209bee tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:22.855736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-877ec3bd-09eb-43ed-af66-7f19c4209bee tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:22.983020 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-877ec3bd-09eb-43ed-af66-7f19c4209bee tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:23:22.991602 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-877ec3bd-09eb-43ed-af66-7f19c4209bee tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1724 microversion: 2.1 time: 0.149480 Sep 04 16:23:22.992163 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 571/1138] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:23:22 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:23:24.015025 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f03108b3-f9d0-4d27-ada4-e0464ad2e2be tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:23:24.015588 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f03108b3-f9d0-4d27-ada4-e0464ad2e2be tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:23:24.022057 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f03108b3-f9d0-4d27-ada4-e0464ad2e2be tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:24.022532 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f03108b3-f9d0-4d27-ada4-e0464ad2e2be tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:24.022989 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f03108b3-f9d0-4d27-ada4-e0464ad2e2be tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:24.023667 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f03108b3-f9d0-4d27-ada4-e0464ad2e2be tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:24.024113 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f03108b3-f9d0-4d27-ada4-e0464ad2e2be tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:24.024531 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f03108b3-f9d0-4d27-ada4-e0464ad2e2be tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:24.151831 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f03108b3-f9d0-4d27-ada4-e0464ad2e2be tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:23:24.160420 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f03108b3-f9d0-4d27-ada4-e0464ad2e2be tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1724 microversion: 2.1 time: 0.149397 Sep 04 16:23:24.161119 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 568/1139] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:23:24 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:23:25.183636 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-05ed8758-599b-425d-8b37-07c91a65a1ac tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:23:25.184245 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-05ed8758-599b-425d-8b37-07c91a65a1ac tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:23:25.190635 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05ed8758-599b-425d-8b37-07c91a65a1ac tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:25.191116 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05ed8758-599b-425d-8b37-07c91a65a1ac tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:25.191550 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05ed8758-599b-425d-8b37-07c91a65a1ac tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:25.192565 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05ed8758-599b-425d-8b37-07c91a65a1ac tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:25.193033 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05ed8758-599b-425d-8b37-07c91a65a1ac tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:25.193458 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05ed8758-599b-425d-8b37-07c91a65a1ac tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:25.320024 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-05ed8758-599b-425d-8b37-07c91a65a1ac tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:23:25.328277 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-05ed8758-599b-425d-8b37-07c91a65a1ac tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1724 microversion: 2.1 time: 0.148522 Sep 04 16:23:25.328851 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 572/1140] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:23:25 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:23:26.352103 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fabb46bd-0dd1-4d0d-9006-0dcdc0d456c0 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:23:26.352716 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fabb46bd-0dd1-4d0d-9006-0dcdc0d456c0 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:23:26.359361 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fabb46bd-0dd1-4d0d-9006-0dcdc0d456c0 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:26.359849 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fabb46bd-0dd1-4d0d-9006-0dcdc0d456c0 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:26.360286 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fabb46bd-0dd1-4d0d-9006-0dcdc0d456c0 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:26.360978 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fabb46bd-0dd1-4d0d-9006-0dcdc0d456c0 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:26.361431 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fabb46bd-0dd1-4d0d-9006-0dcdc0d456c0 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:26.362026 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fabb46bd-0dd1-4d0d-9006-0dcdc0d456c0 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:26.491500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fabb46bd-0dd1-4d0d-9006-0dcdc0d456c0 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:23:26.499695 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fabb46bd-0dd1-4d0d-9006-0dcdc0d456c0 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1724 microversion: 2.1 time: 0.152501 Sep 04 16:23:26.500262 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 569/1141] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:23:26 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:23:27.523768 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fed26873-dca6-4592-ac3c-a46572228033 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:23:27.524377 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fed26873-dca6-4592-ac3c-a46572228033 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:23:27.531076 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fed26873-dca6-4592-ac3c-a46572228033 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:27.531554 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fed26873-dca6-4592-ac3c-a46572228033 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:27.531988 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fed26873-dca6-4592-ac3c-a46572228033 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:27.532704 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fed26873-dca6-4592-ac3c-a46572228033 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:27.533156 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fed26873-dca6-4592-ac3c-a46572228033 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:27.533591 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fed26873-dca6-4592-ac3c-a46572228033 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:27.662962 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-fed26873-dca6-4592-ac3c-a46572228033 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:23:27.671137 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fed26873-dca6-4592-ac3c-a46572228033 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1724 microversion: 2.1 time: 0.151390 Sep 04 16:23:27.671702 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 573/1142] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:23:27 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:23:28.696330 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-df3b8682-0716-4652-96b5-18e39b2a0cc2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:23:28.696856 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-df3b8682-0716-4652-96b5-18e39b2a0cc2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:23:28.703430 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-df3b8682-0716-4652-96b5-18e39b2a0cc2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:28.703912 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-df3b8682-0716-4652-96b5-18e39b2a0cc2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:28.704350 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-df3b8682-0716-4652-96b5-18e39b2a0cc2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:28.705043 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-df3b8682-0716-4652-96b5-18e39b2a0cc2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:28.705537 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-df3b8682-0716-4652-96b5-18e39b2a0cc2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:28.705990 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-df3b8682-0716-4652-96b5-18e39b2a0cc2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:28.838276 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-df3b8682-0716-4652-96b5-18e39b2a0cc2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:23:28.846459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-df3b8682-0716-4652-96b5-18e39b2a0cc2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1724 microversion: 2.1 time: 0.154363 Sep 04 16:23:28.847026 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 570/1143] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:23:28 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:23:29.870451 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a7540447-3d55-41fe-939c-0dba7c453894 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:23:29.871041 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a7540447-3d55-41fe-939c-0dba7c453894 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:23:29.877791 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7540447-3d55-41fe-939c-0dba7c453894 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:29.878301 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7540447-3d55-41fe-939c-0dba7c453894 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:29.878738 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7540447-3d55-41fe-939c-0dba7c453894 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:29.879964 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7540447-3d55-41fe-939c-0dba7c453894 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:29.880425 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7540447-3d55-41fe-939c-0dba7c453894 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:29.880890 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a7540447-3d55-41fe-939c-0dba7c453894 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:30.007896 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a7540447-3d55-41fe-939c-0dba7c453894 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:23:30.016154 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a7540447-3d55-41fe-939c-0dba7c453894 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1724 microversion: 2.1 time: 0.149592 Sep 04 16:23:30.016720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 574/1144] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:23:29 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:23:31.040415 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e3c8880e-a022-49a8-986b-a0bfd72a4ba6 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:23:31.041036 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e3c8880e-a022-49a8-986b-a0bfd72a4ba6 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:23:31.047722 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e3c8880e-a022-49a8-986b-a0bfd72a4ba6 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:31.048220 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e3c8880e-a022-49a8-986b-a0bfd72a4ba6 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:31.048663 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e3c8880e-a022-49a8-986b-a0bfd72a4ba6 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:31.049368 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e3c8880e-a022-49a8-986b-a0bfd72a4ba6 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:31.049850 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e3c8880e-a022-49a8-986b-a0bfd72a4ba6 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:31.050281 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e3c8880e-a022-49a8-986b-a0bfd72a4ba6 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:31.180285 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e3c8880e-a022-49a8-986b-a0bfd72a4ba6 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:23:31.188392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e3c8880e-a022-49a8-986b-a0bfd72a4ba6 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1724 microversion: 2.1 time: 0.152053 Sep 04 16:23:31.188945 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 571/1145] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:23:31 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:23:32.211812 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-344952d9-a40f-40c4-9e8e-e603456dc451 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:23:32.212419 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-344952d9-a40f-40c4-9e8e-e603456dc451 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:23:32.218973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-344952d9-a40f-40c4-9e8e-e603456dc451 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:32.219448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-344952d9-a40f-40c4-9e8e-e603456dc451 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:32.219879 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-344952d9-a40f-40c4-9e8e-e603456dc451 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:32.220557 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-344952d9-a40f-40c4-9e8e-e603456dc451 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:32.221001 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-344952d9-a40f-40c4-9e8e-e603456dc451 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:32.221415 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-344952d9-a40f-40c4-9e8e-e603456dc451 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:32.356419 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-344952d9-a40f-40c4-9e8e-e603456dc451 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:23:32.364895 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-344952d9-a40f-40c4-9e8e-e603456dc451 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1701 microversion: 2.1 time: 0.157472 Sep 04 16:23:32.365458 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 575/1146] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:23:32 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1701 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:23:32.387247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b59fdd2a-8f05-49dc-90af-2f8daeb7dab2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:23:32.393720 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b59fdd2a-8f05-49dc-90af-2f8daeb7dab2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:32.394199 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b59fdd2a-8f05-49dc-90af-2f8daeb7dab2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:32.394632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b59fdd2a-8f05-49dc-90af-2f8daeb7dab2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:32.417938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b59fdd2a-8f05-49dc-90af-2f8daeb7dab2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Going to try to start instance {{(pid=121041) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 04 16:23:32.597306 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b59fdd2a-8f05-49dc-90af-2f8daeb7dab2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "POST /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b/action" status: 202 len: 0 microversion: 2.1 time: 0.213727 Sep 04 16:23:32.597978 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 572/1147] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Sep 4 16:23:32 2022] POST /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:23:32.606368 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c1e3b382-b56e-47bb-bcff-0c9dd8e28580 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:23:32.606984 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c1e3b382-b56e-47bb-bcff-0c9dd8e28580 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:23:32.613054 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1e3b382-b56e-47bb-bcff-0c9dd8e28580 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:32.613542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1e3b382-b56e-47bb-bcff-0c9dd8e28580 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:32.614244 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1e3b382-b56e-47bb-bcff-0c9dd8e28580 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:32.614948 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1e3b382-b56e-47bb-bcff-0c9dd8e28580 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:32.615405 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1e3b382-b56e-47bb-bcff-0c9dd8e28580 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:32.615828 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c1e3b382-b56e-47bb-bcff-0c9dd8e28580 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:32.755772 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c1e3b382-b56e-47bb-bcff-0c9dd8e28580 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:23:32.764070 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c1e3b382-b56e-47bb-bcff-0c9dd8e28580 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1710 microversion: 2.1 time: 0.161719 Sep 04 16:23:32.764640 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 576/1148] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:23:32 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:23:33.793030 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-829d03df-6fad-449e-a210-0c6969d2834b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:23:33.793030 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-829d03df-6fad-449e-a210-0c6969d2834b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:23:33.799957 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-829d03df-6fad-449e-a210-0c6969d2834b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:33.800517 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-829d03df-6fad-449e-a210-0c6969d2834b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:33.800947 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-829d03df-6fad-449e-a210-0c6969d2834b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:33.803004 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-829d03df-6fad-449e-a210-0c6969d2834b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:33.803456 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-829d03df-6fad-449e-a210-0c6969d2834b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:33.803877 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-829d03df-6fad-449e-a210-0c6969d2834b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:33.938257 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-829d03df-6fad-449e-a210-0c6969d2834b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:23:33.947233 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-829d03df-6fad-449e-a210-0c6969d2834b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1710 microversion: 2.1 time: 0.160125 Sep 04 16:23:33.947795 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 573/1149] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:23:33 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1710 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:23:34.971179 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2ef2d25a-a891-4df1-9007-486ee67d357e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:23:34.971788 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2ef2d25a-a891-4df1-9007-486ee67d357e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:23:34.978761 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ef2d25a-a891-4df1-9007-486ee67d357e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:34.979243 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ef2d25a-a891-4df1-9007-486ee67d357e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:34.979675 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ef2d25a-a891-4df1-9007-486ee67d357e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:34.980361 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ef2d25a-a891-4df1-9007-486ee67d357e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:23:34.980818 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ef2d25a-a891-4df1-9007-486ee67d357e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:23:34.981236 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2ef2d25a-a891-4df1-9007-486ee67d357e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:23:35.265301 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-2ef2d25a-a891-4df1-9007-486ee67d357e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:23:35.273537 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2ef2d25a-a891-4df1-9007-486ee67d357e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1714 microversion: 2.1 time: 0.306298 Sep 04 16:23:35.274114 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 577/1150] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:23:34 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1714 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:24:08.375905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-dda36f66-64d3-4c4b-a7e4-3906cc909437 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:08.376501 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-dda36f66-64d3-4c4b-a7e4-3906cc909437 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:08.378700 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=20 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:24:08.379363 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:24:08.384805 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dda36f66-64d3-4c4b-a7e4-3906cc909437 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:08.385279 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dda36f66-64d3-4c4b-a7e4-3906cc909437 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:08.385743 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dda36f66-64d3-4c4b-a7e4-3906cc909437 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:08.386429 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dda36f66-64d3-4c4b-a7e4-3906cc909437 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:08.386870 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dda36f66-64d3-4c4b-a7e4-3906cc909437 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:08.387291 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-dda36f66-64d3-4c4b-a7e4-3906cc909437 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:08.576446 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-dda36f66-64d3-4c4b-a7e4-3906cc909437 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lazy-loading 'services' on Instance uuid b4ab95ba-6b1d-482f-9160-c25b0c3ba82b {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:24:08.759855 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-dda36f66-64d3-4c4b-a7e4-3906cc909437 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b/os-volume_attachments/1254bd59-1fe8-4112-8107-87febf225cab" status: 202 len: 0 microversion: 2.1 time: 0.387758 Sep 04 16:24:08.760449 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 574/1151] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Sep 4 16:24:08 2022] DELETE /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b/os-volume_attachments/1254bd59-1fe8-4112-8107-87febf225cab => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:24:09.883389 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e01e5721-7482-4ece-be1e-4c080dd65b46 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:24:09.886204 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=19 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:24:09.886879 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=59 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:24:09.897542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e01e5721-7482-4ece-be1e-4c080dd65b46 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:09.897542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e01e5721-7482-4ece-be1e-4c080dd65b46 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:09.897542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e01e5721-7482-4ece-be1e-4c080dd65b46 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:09.953550 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e01e5721-7482-4ece-be1e-4c080dd65b46 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Going to try to stop instance {{(pid=121040) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 04 16:24:10.140585 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e01e5721-7482-4ece-be1e-4c080dd65b46 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "POST /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b/action" status: 202 len: 0 microversion: 2.1 time: 0.260860 Sep 04 16:24:10.141182 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 578/1152] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Sep 4 16:24:09 2022] POST /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:24:10.155830 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3497b80c-136c-4e6c-90a4-31c22a4965fb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:10.155830 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3497b80c-136c-4e6c-90a4-31c22a4965fb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:10.158280 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3497b80c-136c-4e6c-90a4-31c22a4965fb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:10.158760 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3497b80c-136c-4e6c-90a4-31c22a4965fb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:10.159199 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3497b80c-136c-4e6c-90a4-31c22a4965fb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:10.159895 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3497b80c-136c-4e6c-90a4-31c22a4965fb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:10.160346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3497b80c-136c-4e6c-90a4-31c22a4965fb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:10.160773 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3497b80c-136c-4e6c-90a4-31c22a4965fb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:10.293961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3497b80c-136c-4e6c-90a4-31c22a4965fb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:24:10.301683 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3497b80c-136c-4e6c-90a4-31c22a4965fb tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1678 microversion: 2.1 time: 0.156058 Sep 04 16:24:10.302248 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 575/1153] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:10 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:24:11.326297 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-65eacd79-bbfa-44cb-958d-08503e66bb5a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:11.326985 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-65eacd79-bbfa-44cb-958d-08503e66bb5a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:11.333093 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65eacd79-bbfa-44cb-958d-08503e66bb5a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:11.333583 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65eacd79-bbfa-44cb-958d-08503e66bb5a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:11.334029 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65eacd79-bbfa-44cb-958d-08503e66bb5a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:11.334716 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65eacd79-bbfa-44cb-958d-08503e66bb5a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:11.335162 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65eacd79-bbfa-44cb-958d-08503e66bb5a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:11.335584 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-65eacd79-bbfa-44cb-958d-08503e66bb5a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:11.467557 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-65eacd79-bbfa-44cb-958d-08503e66bb5a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:24:11.475395 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-65eacd79-bbfa-44cb-958d-08503e66bb5a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1678 microversion: 2.1 time: 0.154822 Sep 04 16:24:11.477216 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 579/1154] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:11 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:24:12.500322 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-20586398-4172-484b-a489-639cd24a14a4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:12.500930 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-20586398-4172-484b-a489-639cd24a14a4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:12.507358 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20586398-4172-484b-a489-639cd24a14a4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:12.507833 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20586398-4172-484b-a489-639cd24a14a4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:12.508267 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20586398-4172-484b-a489-639cd24a14a4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:12.508977 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20586398-4172-484b-a489-639cd24a14a4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:12.509428 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20586398-4172-484b-a489-639cd24a14a4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:12.509874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20586398-4172-484b-a489-639cd24a14a4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:12.639468 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-20586398-4172-484b-a489-639cd24a14a4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:24:12.647239 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-20586398-4172-484b-a489-639cd24a14a4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1678 microversion: 2.1 time: 0.150826 Sep 04 16:24:12.647806 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 576/1155] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:12 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:24:13.671544 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-920bf411-60f2-4d01-a7c7-ed2c097d253f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:13.672077 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-920bf411-60f2-4d01-a7c7-ed2c097d253f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:13.678302 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-920bf411-60f2-4d01-a7c7-ed2c097d253f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:13.678784 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-920bf411-60f2-4d01-a7c7-ed2c097d253f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:13.679221 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-920bf411-60f2-4d01-a7c7-ed2c097d253f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:13.679912 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-920bf411-60f2-4d01-a7c7-ed2c097d253f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:13.680369 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-920bf411-60f2-4d01-a7c7-ed2c097d253f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:13.680865 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-920bf411-60f2-4d01-a7c7-ed2c097d253f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:13.811258 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-920bf411-60f2-4d01-a7c7-ed2c097d253f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:24:13.818885 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-920bf411-60f2-4d01-a7c7-ed2c097d253f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1678 microversion: 2.1 time: 0.151377 Sep 04 16:24:13.819444 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 580/1156] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:13 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:24:14.843854 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9d971808-cef7-4696-82d4-e88dc52a2d40 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:14.844646 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9d971808-cef7-4696-82d4-e88dc52a2d40 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:14.853151 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d971808-cef7-4696-82d4-e88dc52a2d40 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:14.853753 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d971808-cef7-4696-82d4-e88dc52a2d40 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:14.854546 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d971808-cef7-4696-82d4-e88dc52a2d40 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:14.855586 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d971808-cef7-4696-82d4-e88dc52a2d40 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:14.856043 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d971808-cef7-4696-82d4-e88dc52a2d40 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:14.856650 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9d971808-cef7-4696-82d4-e88dc52a2d40 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:14.991717 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9d971808-cef7-4696-82d4-e88dc52a2d40 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:24:14.999485 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9d971808-cef7-4696-82d4-e88dc52a2d40 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1678 microversion: 2.1 time: 0.159627 Sep 04 16:24:15.000048 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 577/1157] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:14 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:24:16.022407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f62197ea-bf49-45a1-97a3-39ac2906c56f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:16.023023 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f62197ea-bf49-45a1-97a3-39ac2906c56f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:16.029482 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f62197ea-bf49-45a1-97a3-39ac2906c56f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:16.029995 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f62197ea-bf49-45a1-97a3-39ac2906c56f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:16.030716 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f62197ea-bf49-45a1-97a3-39ac2906c56f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:16.031403 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f62197ea-bf49-45a1-97a3-39ac2906c56f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:16.031853 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f62197ea-bf49-45a1-97a3-39ac2906c56f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:16.032272 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f62197ea-bf49-45a1-97a3-39ac2906c56f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:16.176708 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f62197ea-bf49-45a1-97a3-39ac2906c56f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:24:16.185102 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f62197ea-bf49-45a1-97a3-39ac2906c56f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1678 microversion: 2.1 time: 0.166507 Sep 04 16:24:16.185688 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 581/1158] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:16 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:24:17.207871 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9595df32-f519-4c4a-a165-4bfe910f6e93 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:17.208486 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9595df32-f519-4c4a-a165-4bfe910f6e93 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:17.215644 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9595df32-f519-4c4a-a165-4bfe910f6e93 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:17.216121 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9595df32-f519-4c4a-a165-4bfe910f6e93 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:17.216547 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9595df32-f519-4c4a-a165-4bfe910f6e93 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:17.217225 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9595df32-f519-4c4a-a165-4bfe910f6e93 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:17.217702 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9595df32-f519-4c4a-a165-4bfe910f6e93 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:17.218118 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9595df32-f519-4c4a-a165-4bfe910f6e93 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:17.348512 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9595df32-f519-4c4a-a165-4bfe910f6e93 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:24:17.358091 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9595df32-f519-4c4a-a165-4bfe910f6e93 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1678 microversion: 2.1 time: 0.154024 Sep 04 16:24:17.358665 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 578/1159] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:17 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:24:18.381666 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7c6b7db0-78d1-4dfe-845c-43a65c5e2589 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:18.382705 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7c6b7db0-78d1-4dfe-845c-43a65c5e2589 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:18.389733 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7c6b7db0-78d1-4dfe-845c-43a65c5e2589 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:18.390208 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7c6b7db0-78d1-4dfe-845c-43a65c5e2589 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:18.390638 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7c6b7db0-78d1-4dfe-845c-43a65c5e2589 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:18.391319 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7c6b7db0-78d1-4dfe-845c-43a65c5e2589 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:18.391767 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7c6b7db0-78d1-4dfe-845c-43a65c5e2589 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:18.392179 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7c6b7db0-78d1-4dfe-845c-43a65c5e2589 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:18.530884 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7c6b7db0-78d1-4dfe-845c-43a65c5e2589 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:24:18.538700 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7c6b7db0-78d1-4dfe-845c-43a65c5e2589 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1678 microversion: 2.1 time: 0.161066 Sep 04 16:24:18.539263 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 582/1160] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:18 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:24:19.562738 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-10a4eb47-412a-4ef2-b255-fe0a86d3d41b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:19.563350 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-10a4eb47-412a-4ef2-b255-fe0a86d3d41b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:19.569667 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10a4eb47-412a-4ef2-b255-fe0a86d3d41b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:19.570151 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10a4eb47-412a-4ef2-b255-fe0a86d3d41b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:19.570593 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10a4eb47-412a-4ef2-b255-fe0a86d3d41b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:19.571367 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10a4eb47-412a-4ef2-b255-fe0a86d3d41b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:19.571840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10a4eb47-412a-4ef2-b255-fe0a86d3d41b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:19.572275 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-10a4eb47-412a-4ef2-b255-fe0a86d3d41b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:19.701235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-10a4eb47-412a-4ef2-b255-fe0a86d3d41b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:24:19.709142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-10a4eb47-412a-4ef2-b255-fe0a86d3d41b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1678 microversion: 2.1 time: 0.150468 Sep 04 16:24:19.709749 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 579/1161] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:19 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:24:20.732626 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-f32ee72e-1ab8-4844-84e8-8e2483f08612 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:20.733255 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-f32ee72e-1ab8-4844-84e8-8e2483f08612 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:20.739647 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f32ee72e-1ab8-4844-84e8-8e2483f08612 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:20.740113 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f32ee72e-1ab8-4844-84e8-8e2483f08612 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:20.740541 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f32ee72e-1ab8-4844-84e8-8e2483f08612 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:20.741225 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f32ee72e-1ab8-4844-84e8-8e2483f08612 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:20.741701 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f32ee72e-1ab8-4844-84e8-8e2483f08612 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:20.742121 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-f32ee72e-1ab8-4844-84e8-8e2483f08612 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:20.868869 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-f32ee72e-1ab8-4844-84e8-8e2483f08612 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:24:20.876448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-f32ee72e-1ab8-4844-84e8-8e2483f08612 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1655 microversion: 2.1 time: 0.147659 Sep 04 16:24:20.876998 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 583/1162] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:20 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1655 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:24:20.899915 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3b964739-9e47-4e04-9256-e99244807da4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:24:20.906718 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b964739-9e47-4e04-9256-e99244807da4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:20.907202 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b964739-9e47-4e04-9256-e99244807da4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:20.907636 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b964739-9e47-4e04-9256-e99244807da4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:20.930257 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3b964739-9e47-4e04-9256-e99244807da4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Going to try to start instance {{(pid=121041) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 04 16:24:21.053695 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3b964739-9e47-4e04-9256-e99244807da4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "POST /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b/action" status: 202 len: 0 microversion: 2.1 time: 0.158689 Sep 04 16:24:21.054301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 580/1163] 10.222.0.39 () {60 vars in 1278 bytes} [Sun Sep 4 16:24:20 2022] POST /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:24:21.062210 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9efeafae-ebc4-4b47-8900-58451e7e7b07 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:21.062810 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9efeafae-ebc4-4b47-8900-58451e7e7b07 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:21.068580 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9efeafae-ebc4-4b47-8900-58451e7e7b07 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:21.069053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9efeafae-ebc4-4b47-8900-58451e7e7b07 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:21.069482 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9efeafae-ebc4-4b47-8900-58451e7e7b07 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:21.070211 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9efeafae-ebc4-4b47-8900-58451e7e7b07 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:21.070658 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9efeafae-ebc4-4b47-8900-58451e7e7b07 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:21.071097 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9efeafae-ebc4-4b47-8900-58451e7e7b07 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:21.213817 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-9efeafae-ebc4-4b47-8900-58451e7e7b07 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:24:21.221593 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9efeafae-ebc4-4b47-8900-58451e7e7b07 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1664 microversion: 2.1 time: 0.163152 Sep 04 16:24:21.222186 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 584/1164] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:21 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1664 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:24:22.245934 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-30141cc0-6a9a-4db7-8fd8-0501c1b80638 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:22.246624 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-30141cc0-6a9a-4db7-8fd8-0501c1b80638 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:22.252654 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30141cc0-6a9a-4db7-8fd8-0501c1b80638 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:22.253125 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30141cc0-6a9a-4db7-8fd8-0501c1b80638 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:22.253556 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30141cc0-6a9a-4db7-8fd8-0501c1b80638 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:22.254286 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30141cc0-6a9a-4db7-8fd8-0501c1b80638 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:22.254723 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30141cc0-6a9a-4db7-8fd8-0501c1b80638 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:22.255139 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-30141cc0-6a9a-4db7-8fd8-0501c1b80638 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:22.394260 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-30141cc0-6a9a-4db7-8fd8-0501c1b80638 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:24:22.402243 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-30141cc0-6a9a-4db7-8fd8-0501c1b80638 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1664 microversion: 2.1 time: 0.161114 Sep 04 16:24:22.402814 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 581/1165] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:22 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1664 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:24:23.425626 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c4903fa7-c891-4a15-9a74-57db600d433f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:23.432078 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c4903fa7-c891-4a15-9a74-57db600d433f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:23.433837 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4903fa7-c891-4a15-9a74-57db600d433f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:23.434327 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4903fa7-c891-4a15-9a74-57db600d433f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:23.434764 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4903fa7-c891-4a15-9a74-57db600d433f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:23.435463 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4903fa7-c891-4a15-9a74-57db600d433f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:23.435925 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4903fa7-c891-4a15-9a74-57db600d433f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:23.436351 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c4903fa7-c891-4a15-9a74-57db600d433f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:23.564156 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-c4903fa7-c891-4a15-9a74-57db600d433f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:24:23.571794 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c4903fa7-c891-4a15-9a74-57db600d433f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1668 microversion: 2.1 time: 0.150079 Sep 04 16:24:23.572362 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 585/1166] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:23 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1668 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:24:39.194671 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-92a49407-b837-4511-95aa-665e8314aaea tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:39.195224 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-92a49407-b837-4511-95aa-665e8314aaea tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 54897af3-bad2-4c84-abce-d028c776b4df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:39.198870 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=16 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:24:39.204437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:24:39.205218 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-92a49407-b837-4511-95aa-665e8314aaea tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:39.205592 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-92a49407-b837-4511-95aa-665e8314aaea tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:39.206124 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-92a49407-b837-4511-95aa-665e8314aaea tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:39.206887 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-92a49407-b837-4511-95aa-665e8314aaea tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:39.207591 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-92a49407-b837-4511-95aa-665e8314aaea tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:39.208238 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-92a49407-b837-4511-95aa-665e8314aaea tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:39.209601 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=16 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:24:39.210459 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:24:39.235404 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-92a49407-b837-4511-95aa-665e8314aaea tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 54897af3-bad2-4c84-abce-d028c776b4df] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 16:24:39.262946 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-26ae28ed-719a-4939-b8af-30cd77f7764d req-8dbd4dc9-53e1-46f7-b52f-07015a9212d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54897af3-bad2-4c84-abce-d028c776b4df", "tag": "02822348-6b65-43f9-869f-901847ad94e2"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:24:39.272285 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-26ae28ed-719a-4939-b8af-30cd77f7764d req-8dbd4dc9-53e1-46f7-b52f-07015a9212d0 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:39.272769 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-26ae28ed-719a-4939-b8af-30cd77f7764d req-8dbd4dc9-53e1-46f7-b52f-07015a9212d0 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:39.273201 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-26ae28ed-719a-4939-b8af-30cd77f7764d req-8dbd4dc9-53e1-46f7-b52f-07015a9212d0 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:39.285096 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-26ae28ed-719a-4939-b8af-30cd77f7764d req-8dbd4dc9-53e1-46f7-b52f-07015a9212d0 service nova] Creating event network-changed:02822348-6b65-43f9-869f-901847ad94e2 for instance 54897af3-bad2-4c84-abce-d028c776b4df on hv-cinder-85236 Sep 04 16:24:39.290230 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-26ae28ed-719a-4939-b8af-30cd77f7764d req-8dbd4dc9-53e1-46f7-b52f-07015a9212d0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097760 Sep 04 16:24:39.290780 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 586/1167] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:24:39.542511 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-92a49407-b837-4511-95aa-665e8314aaea tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "DELETE /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df" status: 204 len: 0 microversion: 2.1 time: 0.351703 Sep 04 16:24:39.543468 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 582/1168] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:24:39 2022] DELETE /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 16:24:39.552252 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d3a5077c-3f67-45ea-bd1d-6582d64bf69a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:39.552865 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d3a5077c-3f67-45ea-bd1d-6582d64bf69a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 54897af3-bad2-4c84-abce-d028c776b4df] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:39.561508 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3a5077c-3f67-45ea-bd1d-6582d64bf69a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:39.562024 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3a5077c-3f67-45ea-bd1d-6582d64bf69a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:39.562467 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3a5077c-3f67-45ea-bd1d-6582d64bf69a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:39.563173 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3a5077c-3f67-45ea-bd1d-6582d64bf69a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:39.565434 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3a5077c-3f67-45ea-bd1d-6582d64bf69a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:39.566483 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d3a5077c-3f67-45ea-bd1d-6582d64bf69a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:39.706019 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d3a5077c-3f67-45ea-bd1d-6582d64bf69a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:24:39.714819 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d3a5077c-3f67-45ea-bd1d-6582d64bf69a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df" status: 200 len: 1576 microversion: 2.1 time: 0.166114 Sep 04 16:24:39.715652 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 587/1169] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:39 2022] GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:24:40.739301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-345eedbe-9504-43d2-ad8b-ff3e4ba92e71 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:40.740039 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-345eedbe-9504-43d2-ad8b-ff3e4ba92e71 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 54897af3-bad2-4c84-abce-d028c776b4df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:40.748080 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-345eedbe-9504-43d2-ad8b-ff3e4ba92e71 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:40.748560 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-345eedbe-9504-43d2-ad8b-ff3e4ba92e71 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:40.748993 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-345eedbe-9504-43d2-ad8b-ff3e4ba92e71 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:40.749713 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-345eedbe-9504-43d2-ad8b-ff3e4ba92e71 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:40.750161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-345eedbe-9504-43d2-ad8b-ff3e4ba92e71 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:40.750583 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-345eedbe-9504-43d2-ad8b-ff3e4ba92e71 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:40.956585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-345eedbe-9504-43d2-ad8b-ff3e4ba92e71 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:24:40.965191 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-345eedbe-9504-43d2-ad8b-ff3e4ba92e71 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df" status: 200 len: 1576 microversion: 2.1 time: 0.230104 Sep 04 16:24:40.965856 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 583/1170] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:40 2022] GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df => generated 1576 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:24:41.803762 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-45b319dd-941d-4429-a33c-e8887a1deca7 req-18d844a2-021e-4cdd-b4a2-e49bc7544717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54897af3-bad2-4c84-abce-d028c776b4df", "name": "network-vif-deleted", "tag": "02822348-6b65-43f9-869f-901847ad94e2"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:24:41.813979 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-45b319dd-941d-4429-a33c-e8887a1deca7 req-18d844a2-021e-4cdd-b4a2-e49bc7544717 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:41.814451 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-45b319dd-941d-4429-a33c-e8887a1deca7 req-18d844a2-021e-4cdd-b4a2-e49bc7544717 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:41.815089 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-45b319dd-941d-4429-a33c-e8887a1deca7 req-18d844a2-021e-4cdd-b4a2-e49bc7544717 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:41.827417 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-45b319dd-941d-4429-a33c-e8887a1deca7 req-18d844a2-021e-4cdd-b4a2-e49bc7544717 service nova] Creating event network-vif-deleted:02822348-6b65-43f9-869f-901847ad94e2 for instance 54897af3-bad2-4c84-abce-d028c776b4df on hv-cinder-85236 Sep 04 16:24:41.832294 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-45b319dd-941d-4429-a33c-e8887a1deca7 req-18d844a2-021e-4cdd-b4a2-e49bc7544717 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087892 Sep 04 16:24:41.833052 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 588/1171] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:24:41.988425 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-e10f7e5d-9d88-47c3-ab85-755c80627788 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:41.988993 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-e10f7e5d-9d88-47c3-ab85-755c80627788 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 54897af3-bad2-4c84-abce-d028c776b4df] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:41.995595 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e10f7e5d-9d88-47c3-ab85-755c80627788 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:41.996269 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e10f7e5d-9d88-47c3-ab85-755c80627788 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:41.996708 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e10f7e5d-9d88-47c3-ab85-755c80627788 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:41.997395 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e10f7e5d-9d88-47c3-ab85-755c80627788 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:41.997880 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e10f7e5d-9d88-47c3-ab85-755c80627788 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:41.998304 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-e10f7e5d-9d88-47c3-ab85-755c80627788 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:42.063411 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-e10f7e5d-9d88-47c3-ab85-755c80627788 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:24:42.071106 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-e10f7e5d-9d88-47c3-ab85-755c80627788 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df" status: 200 len: 1225 microversion: 2.1 time: 0.086594 Sep 04 16:24:42.071898 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 584/1172] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:41 2022] GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:24:43.094531 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-afa7b6de-2442-46cf-9187-ee9bb9c3eb2c tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:43.095311 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-afa7b6de-2442-46cf-9187-ee9bb9c3eb2c tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 54897af3-bad2-4c84-abce-d028c776b4df] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:43.102063 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afa7b6de-2442-46cf-9187-ee9bb9c3eb2c tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:43.105946 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afa7b6de-2442-46cf-9187-ee9bb9c3eb2c tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:43.105946 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afa7b6de-2442-46cf-9187-ee9bb9c3eb2c tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:43.105946 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afa7b6de-2442-46cf-9187-ee9bb9c3eb2c tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:43.105946 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afa7b6de-2442-46cf-9187-ee9bb9c3eb2c tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:43.106312 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-afa7b6de-2442-46cf-9187-ee9bb9c3eb2c tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:43.118396 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-afa7b6de-2442-46cf-9187-ee9bb9c3eb2c tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] HTTP exception thrown: Instance 54897af3-bad2-4c84-abce-d028c776b4df could not be found. Sep 04 16:24:43.119989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-afa7b6de-2442-46cf-9187-ee9bb9c3eb2c tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Request method failure captured: Sep 04 16:24:43.119989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df HTTP/1.1 Sep 04 16:24:43.119989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:24:43.119989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:24:43.119989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:24:43.119989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 04 16:24:43.119989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:24:43.119989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:24:43.119989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:24:43.119989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:24:43.119989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFM8uS7tmOamqPvKNpmBByHHyO3JB88cursd2e2cdQuKNX05bhAE2YlCmcgCuF-D93U9FZ1j0Oklos-aDTy2xmeVtiyjYREMpuzPrVdQ5D8rXeGiVWYGibDg5as-87Ptbd_DwsfNngL4M1u7mMzM5-NE3blKYZ8EUI53K_ZjGpMt4TSs Sep 04 16:24:43.119989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:24:43.119989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:24:43.119989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:24:43.119989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:24:43.119989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:24:43.119989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:24:43.119989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: 56e82ba24a474557af758826743136d9 Sep 04 16:24:43.119989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-TestVolumeBootPattern-2134566845 Sep 04 16:24:43.119989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:24:43.119989 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:24:43.122372 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/56e82ba24a474557af758826743136d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/56e82ba24a474557af758826743136d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_56e82ba24a474557af758826743136d9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/56e82ba24a474557af758826743136d9"}]}] Sep 04 16:24:43.122372 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-TestVolumeBootPattern-2134566845 Sep 04 16:24:43.122372 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: 56e82ba24a474557af758826743136d9 Sep 04 16:24:43.122372 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestVolumeBootPattern-2134566845 Sep 04 16:24:43.122372 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-TestVolumeBootPattern-2134566845-project Sep 04 16:24:43.122372 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:24:43.122372 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:24:43.122372 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: b694f1163ef54b82b86e06bf825c57e4 Sep 04 16:24:43.122372 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-TestVolumeBootPattern-2134566845-project Sep 04 16:24:43.122372 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: > Sep 04 16:24:43.122372 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Instance 54897af3-bad2-4c84-abce-d028c776b4df could not be found. Sep 04 16:24:43.122372 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'id': '54897af3-bad2-4c84-abce-d028c776b4df'} Sep 04 16:24:43.123608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:24:43.123608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:24:43.123608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:24:43.123608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:24:43.123608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:24:43.123608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:24:43.123608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:24:43.123608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:24:43.123608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:24:43.123608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:24:43.123608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54897af3-bad2-4c84-abce-d028c776b4df could not be found. Sep 04 16:24:43.123608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:24:43.123608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:24:43.123608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:24:43.123608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:24:43.123608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:24:43.123608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:24:43.123608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:24:43.123608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:24:43.123608 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:24:43.125207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:24:43.125207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:24:43.125207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:24:43.125207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:24:43.125207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:24:43.125207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:24:43.125207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:24:43.125207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54897af3-bad2-4c84-abce-d028c776b4df could not be found. Sep 04 16:24:43.125207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:24:43.125207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:24:43.125207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:24:43.125207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:24:43.125207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:24:43.125207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:24:43.125207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:24:43.125207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:24:43.125207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54897af3-bad2-4c84-abce-d028c776b4df could not be found. Sep 04 16:24:43.125207 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:24:43.128056 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-afa7b6de-2442-46cf-9187-ee9bb9c3eb2c tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Returning 404 to user: Instance 54897af3-bad2-4c84-abce-d028c776b4df could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:24:43.128056 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-afa7b6de-2442-46cf-9187-ee9bb9c3eb2c tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df" status: 404 len: 111 microversion: 2.1 time: 0.031861 Sep 04 16:24:43.128056 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 589/1173] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:43 2022] GET /compute/v2.1/servers/54897af3-bad2-4c84-abce-d028c776b4df => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:24:46.750344 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-ccb2cd17-3c7c-4c04-8d55-e1ed3136794a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:46.750938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ccb2cd17-3c7c-4c04-8d55-e1ed3136794a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:46.753340 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-e744e96d-9af8-4708-b0d9-5e1e8d1caaeb req-116f758e-bdb3-4382-b3d7-84231fbb4ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c65f38-de9c-4de3-8cf5-92147eb37728", "tag": "329a6f01-f405-46c1-8565-cde5c89b347e"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:24:46.757672 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ccb2cd17-3c7c-4c04-8d55-e1ed3136794a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:46.758161 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ccb2cd17-3c7c-4c04-8d55-e1ed3136794a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:46.758600 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ccb2cd17-3c7c-4c04-8d55-e1ed3136794a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:46.759301 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ccb2cd17-3c7c-4c04-8d55-e1ed3136794a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:46.759760 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ccb2cd17-3c7c-4c04-8d55-e1ed3136794a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:46.760187 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-ccb2cd17-3c7c-4c04-8d55-e1ed3136794a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:46.764923 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e744e96d-9af8-4708-b0d9-5e1e8d1caaeb req-116f758e-bdb3-4382-b3d7-84231fbb4ad7 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:46.765401 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e744e96d-9af8-4708-b0d9-5e1e8d1caaeb req-116f758e-bdb3-4382-b3d7-84231fbb4ad7 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:46.765949 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-e744e96d-9af8-4708-b0d9-5e1e8d1caaeb req-116f758e-bdb3-4382-b3d7-84231fbb4ad7 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:46.778103 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-e744e96d-9af8-4708-b0d9-5e1e8d1caaeb req-116f758e-bdb3-4382-b3d7-84231fbb4ad7 service nova] Creating event network-changed:329a6f01-f405-46c1-8565-cde5c89b347e for instance 04c65f38-de9c-4de3-8cf5-92147eb37728 on hv-cinder-85236 Sep 04 16:24:46.783948 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-e744e96d-9af8-4708-b0d9-5e1e8d1caaeb req-116f758e-bdb3-4382-b3d7-84231fbb4ad7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034800 Sep 04 16:24:46.784820 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 590/1174] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:24:46.790100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-ccb2cd17-3c7c-4c04-8d55-e1ed3136794a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 16:24:47.075622 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-ccb2cd17-3c7c-4c04-8d55-e1ed3136794a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "DELETE /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 204 len: 0 microversion: 2.1 time: 0.329704 Sep 04 16:24:47.079854 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 585/1175] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:24:46 2022] DELETE /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 16:24:47.085807 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7de01097-311a-4ac1-b949-90568580a9e0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:47.086609 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7de01097-311a-4ac1-b949-90568580a9e0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:47.094154 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7de01097-311a-4ac1-b949-90568580a9e0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:47.094959 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7de01097-311a-4ac1-b949-90568580a9e0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:47.095621 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7de01097-311a-4ac1-b949-90568580a9e0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:47.096542 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7de01097-311a-4ac1-b949-90568580a9e0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:47.097108 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7de01097-311a-4ac1-b949-90568580a9e0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:47.097788 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7de01097-311a-4ac1-b949-90568580a9e0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:47.232110 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7de01097-311a-4ac1-b949-90568580a9e0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:24:47.239925 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7de01097-311a-4ac1-b949-90568580a9e0 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1577 microversion: 2.1 time: 0.158697 Sep 04 16:24:47.240572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 591/1176] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:47 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:24:48.264840 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-31c0818b-e1d7-44fa-9174-50f2099f33ae tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:48.265539 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-31c0818b-e1d7-44fa-9174-50f2099f33ae tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:48.271898 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-31c0818b-e1d7-44fa-9174-50f2099f33ae tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:48.272374 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-31c0818b-e1d7-44fa-9174-50f2099f33ae tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:48.272810 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-31c0818b-e1d7-44fa-9174-50f2099f33ae tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:48.273492 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-31c0818b-e1d7-44fa-9174-50f2099f33ae tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:48.273970 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-31c0818b-e1d7-44fa-9174-50f2099f33ae tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:48.274393 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-31c0818b-e1d7-44fa-9174-50f2099f33ae tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:48.488420 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-31c0818b-e1d7-44fa-9174-50f2099f33ae tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:24:48.496920 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-31c0818b-e1d7-44fa-9174-50f2099f33ae tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1577 microversion: 2.1 time: 0.236451 Sep 04 16:24:48.497483 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 586/1177] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:48 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1577 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:24:49.095627 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-fd0fb90f-badc-4ef4-b1cf-8b50ea94d353 req-82c367d6-cf87-4aa8-ae7d-3a02085d2b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c65f38-de9c-4de3-8cf5-92147eb37728", "name": "network-vif-deleted", "tag": "329a6f01-f405-46c1-8565-cde5c89b347e"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:24:49.106473 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-fd0fb90f-badc-4ef4-b1cf-8b50ea94d353 req-82c367d6-cf87-4aa8-ae7d-3a02085d2b09 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:49.108035 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-fd0fb90f-badc-4ef4-b1cf-8b50ea94d353 req-82c367d6-cf87-4aa8-ae7d-3a02085d2b09 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:49.108035 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-fd0fb90f-badc-4ef4-b1cf-8b50ea94d353 req-82c367d6-cf87-4aa8-ae7d-3a02085d2b09 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:49.119971 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-fd0fb90f-badc-4ef4-b1cf-8b50ea94d353 req-82c367d6-cf87-4aa8-ae7d-3a02085d2b09 service nova] Creating event network-vif-deleted:329a6f01-f405-46c1-8565-cde5c89b347e for instance 04c65f38-de9c-4de3-8cf5-92147eb37728 on hv-cinder-85236 Sep 04 16:24:49.124858 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-fd0fb90f-badc-4ef4-b1cf-8b50ea94d353 req-82c367d6-cf87-4aa8-ae7d-3a02085d2b09 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033107 Sep 04 16:24:49.125487 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 592/1178] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:24:49.521925 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b0e610bc-4174-40bb-a0e5-a822a784422a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:49.521925 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b0e610bc-4174-40bb-a0e5-a822a784422a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:49.527877 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0e610bc-4174-40bb-a0e5-a822a784422a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:49.528366 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0e610bc-4174-40bb-a0e5-a822a784422a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:49.528810 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0e610bc-4174-40bb-a0e5-a822a784422a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:49.529508 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0e610bc-4174-40bb-a0e5-a822a784422a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:49.529993 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0e610bc-4174-40bb-a0e5-a822a784422a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:49.530422 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b0e610bc-4174-40bb-a0e5-a822a784422a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:49.592991 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b0e610bc-4174-40bb-a0e5-a822a784422a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b694f1163ef54b82b86e06bf825c57e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e82ba24a474557af758826743136d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:24:49.601130 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b0e610bc-4174-40bb-a0e5-a822a784422a tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 200 len: 1225 microversion: 2.1 time: 0.084754 Sep 04 16:24:49.601723 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 587/1179] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:49 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:24:50.625993 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a9a3adae-0944-4714-a4a1-a2ee41488d52 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:50.626689 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a9a3adae-0944-4714-a4a1-a2ee41488d52 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 04c65f38-de9c-4de3-8cf5-92147eb37728] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:50.632782 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9a3adae-0944-4714-a4a1-a2ee41488d52 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:50.633268 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9a3adae-0944-4714-a4a1-a2ee41488d52 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:50.633729 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9a3adae-0944-4714-a4a1-a2ee41488d52 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:50.634408 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9a3adae-0944-4714-a4a1-a2ee41488d52 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:50.634857 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9a3adae-0944-4714-a4a1-a2ee41488d52 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:50.635274 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9a3adae-0944-4714-a4a1-a2ee41488d52 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:50.648928 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-a9a3adae-0944-4714-a4a1-a2ee41488d52 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] HTTP exception thrown: Instance 04c65f38-de9c-4de3-8cf5-92147eb37728 could not be found. Sep 04 16:24:50.650655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a9a3adae-0944-4714-a4a1-a2ee41488d52 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Request method failure captured: Sep 04 16:24:50.650655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 HTTP/1.1 Sep 04 16:24:50.650655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:24:50.650655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:24:50.650655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:24:50.650655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 04 16:24:50.650655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:24:50.650655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:24:50.650655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:24:50.650655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:24:50.650655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFM8uS7tmOamqPvKNpmBByHHyO3JB88cursd2e2cdQuKNX05bhAE2YlCmcgCuF-D93U9FZ1j0Oklos-aDTy2xmeVtiyjYREMpuzPrVdQ5D8rXeGiVWYGibDg5as-87Ptbd_DwsfNngL4M1u7mMzM5-NE3blKYZ8EUI53K_ZjGpMt4TSs Sep 04 16:24:50.650655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:24:50.650655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:24:50.650655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:24:50.650655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:24:50.650655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:24:50.650655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:24:50.650655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: 56e82ba24a474557af758826743136d9 Sep 04 16:24:50.650655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-TestVolumeBootPattern-2134566845 Sep 04 16:24:50.650655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:24:50.650655 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:24:50.652139 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/56e82ba24a474557af758826743136d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/56e82ba24a474557af758826743136d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_56e82ba24a474557af758826743136d9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/56e82ba24a474557af758826743136d9"}]}] Sep 04 16:24:50.652139 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-TestVolumeBootPattern-2134566845 Sep 04 16:24:50.652139 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: 56e82ba24a474557af758826743136d9 Sep 04 16:24:50.652139 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestVolumeBootPattern-2134566845 Sep 04 16:24:50.652139 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-TestVolumeBootPattern-2134566845-project Sep 04 16:24:50.652139 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:24:50.652139 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:24:50.652139 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: b694f1163ef54b82b86e06bf825c57e4 Sep 04 16:24:50.652139 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-TestVolumeBootPattern-2134566845-project Sep 04 16:24:50.652139 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: > Sep 04 16:24:50.652139 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Instance 04c65f38-de9c-4de3-8cf5-92147eb37728 could not be found. Sep 04 16:24:50.652139 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'id': '04c65f38-de9c-4de3-8cf5-92147eb37728'} Sep 04 16:24:50.652973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:24:50.652973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:24:50.652973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:24:50.652973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:24:50.652973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:24:50.652973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:24:50.652973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:24:50.652973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:24:50.652973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:24:50.652973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:24:50.652973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04c65f38-de9c-4de3-8cf5-92147eb37728 could not be found. Sep 04 16:24:50.652973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:24:50.652973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:24:50.652973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:24:50.652973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:24:50.652973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:24:50.652973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:24:50.652973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:24:50.652973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:24:50.652973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:24:50.654220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:24:50.654220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:24:50.654220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:24:50.654220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:24:50.654220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:24:50.654220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:24:50.654220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:24:50.654220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04c65f38-de9c-4de3-8cf5-92147eb37728 could not be found. Sep 04 16:24:50.654220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:24:50.654220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:24:50.654220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:24:50.654220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:24:50.654220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:24:50.654220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:24:50.654220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:24:50.654220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:24:50.654220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04c65f38-de9c-4de3-8cf5-92147eb37728 could not be found. Sep 04 16:24:50.654220 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:24:50.655334 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a9a3adae-0944-4714-a4a1-a2ee41488d52 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Returning 404 to user: Instance 04c65f38-de9c-4de3-8cf5-92147eb37728 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:24:50.655334 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a9a3adae-0944-4714-a4a1-a2ee41488d52 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728" status: 404 len: 111 microversion: 2.1 time: 0.031786 Sep 04 16:24:50.655334 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 593/1180] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:50 2022] GET /compute/v2.1/servers/04c65f38-de9c-4de3-8cf5-92147eb37728 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:24:51.182564 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5c13f086-0732-4cad-81c0-f1e130fad819 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:51.183396 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-5c13f086-0732-4cad-81c0-f1e130fad819 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:51.190140 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5c13f086-0732-4cad-81c0-f1e130fad819 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:51.190626 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5c13f086-0732-4cad-81c0-f1e130fad819 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:51.191092 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5c13f086-0732-4cad-81c0-f1e130fad819 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:51.191785 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5c13f086-0732-4cad-81c0-f1e130fad819 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:51.192260 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5c13f086-0732-4cad-81c0-f1e130fad819 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:51.192683 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-5c13f086-0732-4cad-81c0-f1e130fad819 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:51.207038 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-5c13f086-0732-4cad-81c0-f1e130fad819 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] HTTP exception thrown: Instance 5d24964d-b2cb-420a-9232-b5662800ec31 could not be found. Sep 04 16:24:51.208688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5c13f086-0732-4cad-81c0-f1e130fad819 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Request method failure captured: Sep 04 16:24:51.208688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: DELETE /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 HTTP/1.1 Sep 04 16:24:51.208688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:24:51.208688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:24:51.208688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:24:51.208688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:24:51.208688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:24:51.208688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:24:51.208688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:24:51.208688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:24:51.208688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFM8uS7tmOamqPvKNpmBByHHyO3JB88cursd2e2cdQuKNX05bhAE2YlCmcgCuF-D93U9FZ1j0Oklos-aDTy2xmeVtiyjYREMpuzPrVdQ5D8rXeGiVWYGibDg5as-87Ptbd_DwsfNngL4M1u7mMzM5-NE3blKYZ8EUI53K_ZjGpMt4TSs Sep 04 16:24:51.208688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:24:51.208688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:24:51.208688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:24:51.208688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:24:51.208688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:24:51.208688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:24:51.208688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: 56e82ba24a474557af758826743136d9 Sep 04 16:24:51.208688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-TestVolumeBootPattern-2134566845 Sep 04 16:24:51.208688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:24:51.208688 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:24:51.210281 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/56e82ba24a474557af758826743136d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/56e82ba24a474557af758826743136d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_56e82ba24a474557af758826743136d9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/56e82ba24a474557af758826743136d9"}]}] Sep 04 16:24:51.210281 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-TestVolumeBootPattern-2134566845 Sep 04 16:24:51.210281 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 56e82ba24a474557af758826743136d9 Sep 04 16:24:51.210281 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-TestVolumeBootPattern-2134566845 Sep 04 16:24:51.210281 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-TestVolumeBootPattern-2134566845-project Sep 04 16:24:51.210281 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:24:51.210281 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:24:51.210281 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: b694f1163ef54b82b86e06bf825c57e4 Sep 04 16:24:51.210281 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-TestVolumeBootPattern-2134566845-project Sep 04 16:24:51.210281 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: > Sep 04 16:24:51.210281 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Instance 5d24964d-b2cb-420a-9232-b5662800ec31 could not be found. Sep 04 16:24:51.210281 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': '5d24964d-b2cb-420a-9232-b5662800ec31'} Sep 04 16:24:51.211437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:24:51.211437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:24:51.211437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:24:51.211437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:24:51.211437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:24:51.211437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:24:51.211437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:24:51.211437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:24:51.211437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:24:51.211437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:24:51.211437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d24964d-b2cb-420a-9232-b5662800ec31 could not be found. Sep 04 16:24:51.211437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:24:51.211437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:24:51.211437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:24:51.211437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:24:51.211437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:24:51.211437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:24:51.211437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:24:51.211437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:24:51.211437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:24:51.212951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:24:51.212951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 04 16:24:51.212951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 04 16:24:51.212951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 04 16:24:51.212951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 04 16:24:51.212951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:24:51.212951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:24:51.212951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:24:51.212951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:24:51.212951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d24964d-b2cb-420a-9232-b5662800ec31 could not be found. Sep 04 16:24:51.212951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:24:51.212951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:24:51.212951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:24:51.212951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:24:51.212951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:24:51.212951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:24:51.212951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:24:51.212951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:24:51.212951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d24964d-b2cb-420a-9232-b5662800ec31 could not be found. Sep 04 16:24:51.212951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:24:51.215448 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-5c13f086-0732-4cad-81c0-f1e130fad819 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Returning 404 to user: Instance 5d24964d-b2cb-420a-9232-b5662800ec31 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:24:51.215448 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-5c13f086-0732-4cad-81c0-f1e130fad819 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 404 len: 111 microversion: 2.1 time: 0.031520 Sep 04 16:24:51.215448 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 588/1181] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:24:51 2022] DELETE /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:24:51.219201 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7fd264ed-189c-4b98-b9a3-09cd2c9eb8a7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:51.219805 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7fd264ed-189c-4b98-b9a3-09cd2c9eb8a7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] [instance: 5d24964d-b2cb-420a-9232-b5662800ec31] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:51.225798 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fd264ed-189c-4b98-b9a3-09cd2c9eb8a7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:51.226265 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fd264ed-189c-4b98-b9a3-09cd2c9eb8a7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:51.226689 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fd264ed-189c-4b98-b9a3-09cd2c9eb8a7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:51.227361 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fd264ed-189c-4b98-b9a3-09cd2c9eb8a7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:51.227830 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fd264ed-189c-4b98-b9a3-09cd2c9eb8a7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:51.228249 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-7fd264ed-189c-4b98-b9a3-09cd2c9eb8a7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:51.241253 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-7fd264ed-189c-4b98-b9a3-09cd2c9eb8a7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] HTTP exception thrown: Instance 5d24964d-b2cb-420a-9232-b5662800ec31 could not be found. Sep 04 16:24:51.242797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7fd264ed-189c-4b98-b9a3-09cd2c9eb8a7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Request method failure captured: Sep 04 16:24:51.242797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 HTTP/1.1 Sep 04 16:24:51.242797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:24:51.242797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:24:51.242797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:24:51.242797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 04 16:24:51.242797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:24:51.242797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:24:51.242797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:24:51.242797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:24:51.242797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFM8uS7tmOamqPvKNpmBByHHyO3JB88cursd2e2cdQuKNX05bhAE2YlCmcgCuF-D93U9FZ1j0Oklos-aDTy2xmeVtiyjYREMpuzPrVdQ5D8rXeGiVWYGibDg5as-87Ptbd_DwsfNngL4M1u7mMzM5-NE3blKYZ8EUI53K_ZjGpMt4TSs Sep 04 16:24:51.242797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:24:51.242797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:24:51.242797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:24:51.242797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:24:51.242797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:24:51.242797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:24:51.242797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: 56e82ba24a474557af758826743136d9 Sep 04 16:24:51.242797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-TestVolumeBootPattern-2134566845 Sep 04 16:24:51.242797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:24:51.242797 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:24:51.244492 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/56e82ba24a474557af758826743136d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/56e82ba24a474557af758826743136d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_56e82ba24a474557af758826743136d9", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/56e82ba24a474557af758826743136d9"}]}] Sep 04 16:24:51.244492 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-TestVolumeBootPattern-2134566845 Sep 04 16:24:51.244492 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: 56e82ba24a474557af758826743136d9 Sep 04 16:24:51.244492 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-TestVolumeBootPattern-2134566845 Sep 04 16:24:51.244492 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-TestVolumeBootPattern-2134566845-project Sep 04 16:24:51.244492 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:24:51.244492 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:24:51.244492 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: b694f1163ef54b82b86e06bf825c57e4 Sep 04 16:24:51.244492 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-TestVolumeBootPattern-2134566845-project Sep 04 16:24:51.244492 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: > Sep 04 16:24:51.244492 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Instance 5d24964d-b2cb-420a-9232-b5662800ec31 could not be found. Sep 04 16:24:51.244492 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'id': '5d24964d-b2cb-420a-9232-b5662800ec31'} Sep 04 16:24:51.245548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:24:51.245548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:24:51.245548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:24:51.245548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:24:51.245548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:24:51.245548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:24:51.245548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:24:51.245548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:24:51.245548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:24:51.245548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:24:51.245548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d24964d-b2cb-420a-9232-b5662800ec31 could not be found. Sep 04 16:24:51.245548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:24:51.245548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:24:51.245548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:24:51.245548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:24:51.245548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:24:51.245548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:24:51.245548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:24:51.245548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:24:51.245548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:24:51.247034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:24:51.247034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:24:51.247034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:24:51.247034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:24:51.247034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:24:51.247034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:24:51.247034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:24:51.247034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d24964d-b2cb-420a-9232-b5662800ec31 could not be found. Sep 04 16:24:51.247034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:24:51.247034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:24:51.247034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:24:51.247034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:24:51.247034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:24:51.247034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:24:51.247034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:24:51.247034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:24:51.247034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d24964d-b2cb-420a-9232-b5662800ec31 could not be found. Sep 04 16:24:51.247034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:24:51.248502 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7fd264ed-189c-4b98-b9a3-09cd2c9eb8a7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Returning 404 to user: Instance 5d24964d-b2cb-420a-9232-b5662800ec31 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:24:51.248502 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7fd264ed-189c-4b98-b9a3-09cd2c9eb8a7 tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31" status: 404 len: 111 microversion: 2.1 time: 0.028728 Sep 04 16:24:51.248502 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 594/1182] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:51 2022] GET /compute/v2.1/servers/5d24964d-b2cb-420a-9232-b5662800ec31 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:24:52.715409 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-d3a57206-d121-4cd0-8c45-d7e8fcb91f9c tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] Calling method '.version_select at 0x7f968aa310d0>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:52.801792 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-d3a57206-d121-4cd0-8c45-d7e8fcb91f9c tempest-TestVolumeBootPattern-2134566845 tempest-TestVolumeBootPattern-2134566845-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2049353985" status: 202 len: 0 microversion: 2.1 time: 0.091685 Sep 04 16:24:52.802411 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 589/1183] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Sep 4 16:24:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2049353985 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:24:55.656866 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-2e21b5a2-2bfd-4294-9582-683db215120a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:55.663746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-2e21b5a2-2bfd-4294-9582-683db215120a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:55.671302 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e21b5a2-2bfd-4294-9582-683db215120a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:55.672036 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e21b5a2-2bfd-4294-9582-683db215120a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:55.672769 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e21b5a2-2bfd-4294-9582-683db215120a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:55.673470 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e21b5a2-2bfd-4294-9582-683db215120a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:55.673976 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e21b5a2-2bfd-4294-9582-683db215120a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:55.674684 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-2e21b5a2-2bfd-4294-9582-683db215120a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:55.721749 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-2e21b5a2-2bfd-4294-9582-683db215120a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072191 Sep 04 16:24:55.723265 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 595/1184] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:24:55 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 04 16:24:55.824160 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-074aa7d0-86b4-4a0f-a93e-213d27cc79b5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:55.824667 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-074aa7d0-86b4-4a0f-a93e-213d27cc79b5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:55.835015 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-074aa7d0-86b4-4a0f-a93e-213d27cc79b5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:55.837075 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-074aa7d0-86b4-4a0f-a93e-213d27cc79b5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:55.837075 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-074aa7d0-86b4-4a0f-a93e-213d27cc79b5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:55.837075 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-074aa7d0-86b4-4a0f-a93e-213d27cc79b5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:55.837412 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-074aa7d0-86b4-4a0f-a93e-213d27cc79b5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:55.838068 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-074aa7d0-86b4-4a0f-a93e-213d27cc79b5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:55.870096 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-074aa7d0-86b4-4a0f-a93e-213d27cc79b5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 16:24:56.128181 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-074aa7d0-86b4-4a0f-a93e-213d27cc79b5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 204 len: 0 microversion: 2.1 time: 0.306772 Sep 04 16:24:56.136376 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1acda2c3-86b7-49fc-9d6f-213ddb50b334 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:56.137438 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1acda2c3-86b7-49fc-9d6f-213ddb50b334 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:56.139815 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 590/1185] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:24:55 2022] DELETE /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 16:24:56.145293 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1acda2c3-86b7-49fc-9d6f-213ddb50b334 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:56.146329 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1acda2c3-86b7-49fc-9d6f-213ddb50b334 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:56.146788 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1acda2c3-86b7-49fc-9d6f-213ddb50b334 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:56.147848 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1acda2c3-86b7-49fc-9d6f-213ddb50b334 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:56.148640 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1acda2c3-86b7-49fc-9d6f-213ddb50b334 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:56.149446 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1acda2c3-86b7-49fc-9d6f-213ddb50b334 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:56.391159 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1acda2c3-86b7-49fc-9d6f-213ddb50b334 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:24:56.399444 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1acda2c3-86b7-49fc-9d6f-213ddb50b334 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1674 microversion: 2.1 time: 0.268042 Sep 04 16:24:56.400211 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 596/1186] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:56 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1674 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:24:57.428080 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9f7d47cc-1051-4ac0-8761-29f4a8e081f6 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:57.428783 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9f7d47cc-1051-4ac0-8761-29f4a8e081f6 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:57.435558 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9f7d47cc-1051-4ac0-8761-29f4a8e081f6 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:57.436040 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9f7d47cc-1051-4ac0-8761-29f4a8e081f6 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:57.436476 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9f7d47cc-1051-4ac0-8761-29f4a8e081f6 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:57.437168 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9f7d47cc-1051-4ac0-8761-29f4a8e081f6 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:57.437663 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9f7d47cc-1051-4ac0-8761-29f4a8e081f6 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:57.438091 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9f7d47cc-1051-4ac0-8761-29f4a8e081f6 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:57.584172 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9f7d47cc-1051-4ac0-8761-29f4a8e081f6 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:24:57.596291 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9f7d47cc-1051-4ac0-8761-29f4a8e081f6 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1674 microversion: 2.1 time: 0.172332 Sep 04 16:24:57.601396 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 591/1187] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:57 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:24:58.620701 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-000224de-036c-4686-a874-20bb8ee1d52e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:58.621429 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-000224de-036c-4686-a874-20bb8ee1d52e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:58.628005 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-000224de-036c-4686-a874-20bb8ee1d52e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:58.628728 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-000224de-036c-4686-a874-20bb8ee1d52e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:58.629229 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-000224de-036c-4686-a874-20bb8ee1d52e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:58.629906 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-000224de-036c-4686-a874-20bb8ee1d52e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:58.630356 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-000224de-036c-4686-a874-20bb8ee1d52e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:58.630777 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-000224de-036c-4686-a874-20bb8ee1d52e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:58.793053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-000224de-036c-4686-a874-20bb8ee1d52e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:24:58.804519 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-000224de-036c-4686-a874-20bb8ee1d52e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1674 microversion: 2.1 time: 0.187186 Sep 04 16:24:58.825069 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 597/1188] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:58 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1674 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:24:59.169867 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-4fc01edb-3553-4412-a238-0087728a5b6b req-92381c0d-2b04-43dc-b8ef-f514a36abbfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ab95ba-6b1d-482f-9160-c25b0c3ba82b", "name": "network-vif-deleted", "tag": "2ba1839b-cf90-4859-94e6-4295e7f3acba"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:24:59.181808 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-4fc01edb-3553-4412-a238-0087728a5b6b req-92381c0d-2b04-43dc-b8ef-f514a36abbfa service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:59.186202 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-4fc01edb-3553-4412-a238-0087728a5b6b req-92381c0d-2b04-43dc-b8ef-f514a36abbfa service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:59.186202 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-4fc01edb-3553-4412-a238-0087728a5b6b req-92381c0d-2b04-43dc-b8ef-f514a36abbfa service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:59.199424 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-4fc01edb-3553-4412-a238-0087728a5b6b req-92381c0d-2b04-43dc-b8ef-f514a36abbfa service nova] Creating event network-vif-deleted:2ba1839b-cf90-4859-94e6-4295e7f3acba for instance b4ab95ba-6b1d-482f-9160-c25b0c3ba82b on hv-cinder-85236 Sep 04 16:24:59.205334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-4fc01edb-3553-4412-a238-0087728a5b6b req-92381c0d-2b04-43dc-b8ef-f514a36abbfa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040169 Sep 04 16:24:59.206570 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 592/1189] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:24:59.831979 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-b91345f0-2926-44ed-b567-175c50aa2a10 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:24:59.835396 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-b91345f0-2926-44ed-b567-175c50aa2a10 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:24:59.844062 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b91345f0-2926-44ed-b567-175c50aa2a10 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:59.844062 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b91345f0-2926-44ed-b567-175c50aa2a10 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:59.844062 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b91345f0-2926-44ed-b567-175c50aa2a10 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:59.844062 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b91345f0-2926-44ed-b567-175c50aa2a10 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:59.844495 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b91345f0-2926-44ed-b567-175c50aa2a10 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:59.844495 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b91345f0-2926-44ed-b567-175c50aa2a10 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:59.875551 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b91345f0-2926-44ed-b567-175c50aa2a10 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:24:59.876037 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b91345f0-2926-44ed-b567-175c50aa2a10 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:24:59.876462 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-b91345f0-2926-44ed-b567-175c50aa2a10 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:24:59.877077 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-b91345f0-2926-44ed-b567-175c50aa2a10 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lazy-loading 'fault' on Instance uuid b4ab95ba-6b1d-482f-9160-c25b0c3ba82b {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:24:59.947410 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-b91345f0-2926-44ed-b567-175c50aa2a10 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:24:59.956871 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-b91345f0-2926-44ed-b567-175c50aa2a10 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 200 len: 1328 microversion: 2.1 time: 0.128650 Sep 04 16:24:59.957510 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 598/1190] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:24:59 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 1328 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:25:00.981597 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-983f6f23-2c6d-4066-a5da-a8c7a11ad035 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:25:00.982268 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-983f6f23-2c6d-4066-a5da-a8c7a11ad035 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:25:00.988330 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-983f6f23-2c6d-4066-a5da-a8c7a11ad035 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:00.988791 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-983f6f23-2c6d-4066-a5da-a8c7a11ad035 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:00.989218 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-983f6f23-2c6d-4066-a5da-a8c7a11ad035 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:00.990022 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-983f6f23-2c6d-4066-a5da-a8c7a11ad035 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:00.990469 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-983f6f23-2c6d-4066-a5da-a8c7a11ad035 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:00.993214 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-983f6f23-2c6d-4066-a5da-a8c7a11ad035 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:01.004573 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-983f6f23-2c6d-4066-a5da-a8c7a11ad035 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] HTTP exception thrown: Instance b4ab95ba-6b1d-482f-9160-c25b0c3ba82b could not be found. Sep 04 16:25:01.006208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-983f6f23-2c6d-4066-a5da-a8c7a11ad035 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Request method failure captured: Sep 04 16:25:01.006208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b HTTP/1.1 Sep 04 16:25:01.006208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:25:01.006208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:25:01.006208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:25:01.006208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:25:01.006208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:25:01.006208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:25:01.006208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:25:01.006208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:25:01.006208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFNCwPsNLOqN2R5acwUcgKonlmm3BbYspMprQDepoYiAKqsgcY0hWq1GQH0V6RDSl1H50EN9w3S3YJ1owauf9S8NF20RJCbKN3aPByDtXZET8XrEHAvUTpj8oqI4-3yM6ObAYjlMZRjVmUNVqlYPNPizaD1JNxJUqixh2SfB9WVMaRZY Sep 04 16:25:01.006208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:25:01.006208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:25:01.006208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:25:01.006208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:25:01.006208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:25:01.006208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:25:01.006208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: 6dde43a19e95472d87ea4273922156be Sep 04 16:25:01.006208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeTestJSON-1717945144 Sep 04 16:25:01.006208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:25:01.006208 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:25:01.007866 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6dde43a19e95472d87ea4273922156be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6dde43a19e95472d87ea4273922156be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6dde43a19e95472d87ea4273922156be", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6dde43a19e95472d87ea4273922156be"}]}] Sep 04 16:25:01.007866 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeTestJSON-1717945144 Sep 04 16:25:01.007866 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 6dde43a19e95472d87ea4273922156be Sep 04 16:25:01.007866 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1717945144 Sep 04 16:25:01.007866 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeTestJSON-1717945144-project Sep 04 16:25:01.007866 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:25:01.007866 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:25:01.007866 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: b1fa7bf738264e77b868ce9d7863214e Sep 04 16:25:01.007866 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeTestJSON-1717945144-project Sep 04 16:25:01.007866 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: > Sep 04 16:25:01.007866 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Instance b4ab95ba-6b1d-482f-9160-c25b0c3ba82b could not be found. Sep 04 16:25:01.007866 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': 'b4ab95ba-6b1d-482f-9160-c25b0c3ba82b'} Sep 04 16:25:01.008884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:25:01.008884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:25:01.008884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:25:01.008884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:25:01.008884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:25:01.008884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:25:01.008884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:25:01.008884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:25:01.008884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:25:01.008884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:25:01.008884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4ab95ba-6b1d-482f-9160-c25b0c3ba82b could not be found. Sep 04 16:25:01.008884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:25:01.008884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:25:01.008884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:25:01.008884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:25:01.008884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:25:01.008884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:25:01.008884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:25:01.008884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:25:01.008884 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:25:01.010407 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:25:01.010407 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:25:01.010407 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:25:01.010407 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:25:01.010407 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:25:01.010407 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:25:01.010407 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:25:01.010407 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4ab95ba-6b1d-482f-9160-c25b0c3ba82b could not be found. Sep 04 16:25:01.010407 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:25:01.010407 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:25:01.010407 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:25:01.010407 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:25:01.010407 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:25:01.010407 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:25:01.010407 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:25:01.010407 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:25:01.010407 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4ab95ba-6b1d-482f-9160-c25b0c3ba82b could not be found. Sep 04 16:25:01.010407 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:25:01.012604 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-983f6f23-2c6d-4066-a5da-a8c7a11ad035 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Returning 404 to user: Instance b4ab95ba-6b1d-482f-9160-c25b0c3ba82b could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:25:01.012604 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-983f6f23-2c6d-4066-a5da-a8c7a11ad035 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 404 len: 111 microversion: 2.1 time: 0.031161 Sep 04 16:25:01.012604 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 593/1191] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:25:00 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:25:01.017746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-39795ab5-848e-4f82-b8f1-f4368d7be556 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '.version_select at 0x7f96895d4d30>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:25:01.093662 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-39795ab5-848e-4f82-b8f1-f4368d7be556 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1638602846" status: 202 len: 0 microversion: 2.1 time: 0.079753 Sep 04 16:25:01.094277 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 599/1192] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Sep 4 16:25:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1638602846 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:25:01.956457 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-235fb960-1c9d-4786-9624-66fd2bb4578b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Action: 'create', calling method: .version_select at 0x7f9689292160>, body: {"keypair": {"name": "tempest-keypair-1355232508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLUDfBGpeT7wWedQNHUQjYs8GO7zIHn0blhKlib+TpXeKOU8v+Rm8zwN2hfY9nEUt2FeI+PSu0jWH0WvgsT8F9mVpVQkUeA824dcPlFkGZHgRJI5GJCTlyF/TaEQXoBgA=="}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:25:01.978796 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-235fb960-1c9d-4786-9624-66fd2bb4578b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Getting quotas for project 6dde43a19e95472d87ea4273922156be. Resources: {'key_pairs'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:25:01.983804 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-235fb960-1c9d-4786-9624-66fd2bb4578b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Getting quotas for user b1fa7bf738264e77b868ce9d7863214e and project 6dde43a19e95472d87ea4273922156be. Resources: {'key_pairs'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:25:02.070376 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-235fb960-1c9d-4786-9624-66fd2bb4578b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.117826 Sep 04 16:25:02.074295 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 594/1193] 10.222.0.39 () {60 vars in 1159 bytes} [Sun Sep 4 16:25:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:25:04.159400 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-002c99ca-0f04-444b-a810-3983fd802c18 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-237145159", "imageRef": "11a460f6-29b0-46e6-ae98-e53ee2e13520", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c473da39-bd28-4e2e-830f-12458827922d"}], "security_groups": [{"name": "tempest-securitygroup--1522287381"}], "key_name": "tempest-keypair-1355232508", "user_data": "}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:25:04.264537 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-002c99ca-0f04-444b-a810-3983fd802c18 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] validate_networks() for [('c473da39-bd28-4e2e-830f-12458827922d', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 16:25:04.637131 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-002c99ca-0f04-444b-a810-3983fd802c18 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 16:25:04.637541 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-002c99ca-0f04-444b-a810-3983fd802c18 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 16:25:04.638034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-002c99ca-0f04-444b-a810-3983fd802c18 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 16:25:04.638436 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-002c99ca-0f04-444b-a810-3983fd802c18 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 16:25:04.638839 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-002c99ca-0f04-444b-a810-3983fd802c18 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 16:25:04.647511 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-002c99ca-0f04-444b-a810-3983fd802c18 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:04.647987 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-002c99ca-0f04-444b-a810-3983fd802c18 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:04.648413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-002c99ca-0f04-444b-a810-3983fd802c18 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:04.649123 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-002c99ca-0f04-444b-a810-3983fd802c18 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:04.649582 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-002c99ca-0f04-444b-a810-3983fd802c18 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:04.650006 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-002c99ca-0f04-444b-a810-3983fd802c18 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:04.667870 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-002c99ca-0f04-444b-a810-3983fd802c18 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Getting quotas for project 6dde43a19e95472d87ea4273922156be. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:25:04.672109 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-002c99ca-0f04-444b-a810-3983fd802c18 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Getting quotas for user b1fa7bf738264e77b868ce9d7863214e and project 6dde43a19e95472d87ea4273922156be. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:25:04.683475 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-002c99ca-0f04-444b-a810-3983fd802c18 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 16:25:04.685827 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-002c99ca-0f04-444b-a810-3983fd802c18 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a460f6-29b0-46e6-ae98-e53ee2e13520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 16:25:04.811951 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR oslo.messaging._drivers.impl_rabbit [None req-002c99ca-0f04-444b-a810-3983fd802c18 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [c42624e6-71be-4942-b68e-6f8270462543] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 04 16:25:05.820345 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO oslo.messaging._drivers.impl_rabbit [None req-002c99ca-0f04-444b-a810-3983fd802c18 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [c42624e6-71be-4942-b68e-6f8270462543] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 46668. Sep 04 16:25:05.825389 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-002c99ca-0f04-444b-a810-3983fd802c18 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.671035 Sep 04 16:25:05.826323 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 600/1194] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Sep 4 16:25:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 1673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 16:25:05.865496 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1ab49594-425b-41b9-afe9-0aafdbd821a3 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:25:05.865496 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1ab49594-425b-41b9-afe9-0aafdbd821a3 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:25:05.908147 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1ab49594-425b-41b9-afe9-0aafdbd821a3 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:25:05.915209 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1ab49594-425b-41b9-afe9-0aafdbd821a3 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374" status: 200 len: 1237 microversion: 2.1 time: 0.077363 Sep 04 16:25:05.915762 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 595/1195] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:25:05 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374 => generated 1237 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:25:06.938349 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-7e068a20-2cf8-4434-83cb-03e773ce0345 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:25:06.938953 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-7e068a20-2cf8-4434-83cb-03e773ce0345 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:25:06.992201 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-7e068a20-2cf8-4434-83cb-03e773ce0345 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:25:06.999598 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-7e068a20-2cf8-4434-83cb-03e773ce0345 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374" status: 200 len: 1237 microversion: 2.1 time: 0.065571 Sep 04 16:25:07.000167 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 601/1196] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:25:06 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:25:08.021737 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-776ec017-2c4b-48f1-beff-a1708a6b8b66 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:25:08.022346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-776ec017-2c4b-48f1-beff-a1708a6b8b66 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:25:08.076140 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-776ec017-2c4b-48f1-beff-a1708a6b8b66 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:25:08.083163 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-776ec017-2c4b-48f1-beff-a1708a6b8b66 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374" status: 200 len: 1237 microversion: 2.1 time: 0.065293 Sep 04 16:25:08.084049 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 596/1197] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:25:08 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:25:09.107073 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-efbe95fc-8f40-4073-8cdf-8b6d27165430 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:25:09.108503 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-efbe95fc-8f40-4073-8cdf-8b6d27165430 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:25:09.115015 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efbe95fc-8f40-4073-8cdf-8b6d27165430 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:09.115487 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efbe95fc-8f40-4073-8cdf-8b6d27165430 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:09.115910 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efbe95fc-8f40-4073-8cdf-8b6d27165430 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:09.116591 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efbe95fc-8f40-4073-8cdf-8b6d27165430 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:09.117034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efbe95fc-8f40-4073-8cdf-8b6d27165430 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:09.117447 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-efbe95fc-8f40-4073-8cdf-8b6d27165430 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:09.184296 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-efbe95fc-8f40-4073-8cdf-8b6d27165430 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:25:09.192363 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-efbe95fc-8f40-4073-8cdf-8b6d27165430 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374" status: 200 len: 1289 microversion: 2.1 time: 0.089160 Sep 04 16:25:09.192927 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 602/1198] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:25:09 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374 => generated 1289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:25:10.216951 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-acad586b-07d3-4533-98ec-134552151d2a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:25:10.217593 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-acad586b-07d3-4533-98ec-134552151d2a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:25:10.219982 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:25:10.224694 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-acad586b-07d3-4533-98ec-134552151d2a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:10.225109 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-acad586b-07d3-4533-98ec-134552151d2a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:10.225540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-acad586b-07d3-4533-98ec-134552151d2a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:10.226251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-acad586b-07d3-4533-98ec-134552151d2a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:10.226706 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-acad586b-07d3-4533-98ec-134552151d2a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:10.227125 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-acad586b-07d3-4533-98ec-134552151d2a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:10.303221 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-acad586b-07d3-4533-98ec-134552151d2a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:25:10.311479 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-acad586b-07d3-4533-98ec-134552151d2a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374" status: 200 len: 1295 microversion: 2.1 time: 0.098944 Sep 04 16:25:10.312150 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 597/1199] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:25:10 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374 => generated 1295 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:25:11.325991 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-639ce84a-956c-40f2-bad5-e78bd2f70218 req-64ffcb00-c5d3-43ff-b801-b6ab82743fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd0a9170-7b56-4c9a-a918-abd9847f4374", "tag": "e695d60e-6b7d-4b70-8196-908884f7dc65"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:25:11.332364 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:25:11.338783 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-639ce84a-956c-40f2-bad5-e78bd2f70218 req-64ffcb00-c5d3-43ff-b801-b6ab82743fd1 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:11.339287 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-639ce84a-956c-40f2-bad5-e78bd2f70218 req-64ffcb00-c5d3-43ff-b801-b6ab82743fd1 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:11.339704 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-639ce84a-956c-40f2-bad5-e78bd2f70218 req-64ffcb00-c5d3-43ff-b801-b6ab82743fd1 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:11.340244 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-904baaef-6caa-4773-a403-068e0f5e21ac tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:25:11.340976 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-904baaef-6caa-4773-a403-068e0f5e21ac tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:25:11.344582 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=61 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:25:11.348713 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-904baaef-6caa-4773-a403-068e0f5e21ac tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:11.349522 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-904baaef-6caa-4773-a403-068e0f5e21ac tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:11.350080 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-904baaef-6caa-4773-a403-068e0f5e21ac tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:11.350994 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-904baaef-6caa-4773-a403-068e0f5e21ac tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:11.351619 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-904baaef-6caa-4773-a403-068e0f5e21ac tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:11.351768 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-639ce84a-956c-40f2-bad5-e78bd2f70218 req-64ffcb00-c5d3-43ff-b801-b6ab82743fd1 service nova] Creating event network-changed:e695d60e-6b7d-4b70-8196-908884f7dc65 for instance fd0a9170-7b56-4c9a-a918-abd9847f4374 on hv-cinder-85236 Sep 04 16:25:11.352050 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-904baaef-6caa-4773-a403-068e0f5e21ac tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:11.358157 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:25:11.358440 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-639ce84a-956c-40f2-bad5-e78bd2f70218 req-64ffcb00-c5d3-43ff-b801-b6ab82743fd1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037903 Sep 04 16:25:11.359037 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 603/1200] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:25:11.575186 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-904baaef-6caa-4773-a403-068e0f5e21ac tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:25:11.582435 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-904baaef-6caa-4773-a403-068e0f5e21ac tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374" status: 200 len: 1363 microversion: 2.1 time: 0.248315 Sep 04 16:25:11.583019 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 598/1201] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:25:11 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374 => generated 1363 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:25:12.606406 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-117548c8-a1ef-4aa6-845c-1a412781ced2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:25:12.607053 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-117548c8-a1ef-4aa6-845c-1a412781ced2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:25:12.614702 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-117548c8-a1ef-4aa6-845c-1a412781ced2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:12.615173 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-117548c8-a1ef-4aa6-845c-1a412781ced2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:12.615597 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-117548c8-a1ef-4aa6-845c-1a412781ced2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:12.616285 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-117548c8-a1ef-4aa6-845c-1a412781ced2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:12.616726 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-117548c8-a1ef-4aa6-845c-1a412781ced2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:12.617140 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-117548c8-a1ef-4aa6-845c-1a412781ced2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:12.753175 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-117548c8-a1ef-4aa6-845c-1a412781ced2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:25:12.762521 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-117548c8-a1ef-4aa6-845c-1a412781ced2 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374" status: 200 len: 1363 microversion: 2.1 time: 0.160797 Sep 04 16:25:12.763090 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 604/1202] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:25:12 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:25:13.785856 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-43810f1d-e870-45ba-b728-3988c62a77f5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:25:13.786396 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-43810f1d-e870-45ba-b728-3988c62a77f5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:25:13.794581 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-43810f1d-e870-45ba-b728-3988c62a77f5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:13.795064 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-43810f1d-e870-45ba-b728-3988c62a77f5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:13.795499 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-43810f1d-e870-45ba-b728-3988c62a77f5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:13.796262 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-43810f1d-e870-45ba-b728-3988c62a77f5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:13.796716 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-43810f1d-e870-45ba-b728-3988c62a77f5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:13.797147 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-43810f1d-e870-45ba-b728-3988c62a77f5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:13.923959 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-43810f1d-e870-45ba-b728-3988c62a77f5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:25:13.931585 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-43810f1d-e870-45ba-b728-3988c62a77f5 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374" status: 200 len: 1363 microversion: 2.1 time: 0.150437 Sep 04 16:25:13.932152 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 599/1203] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:25:13 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:25:14.956186 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e5e7e695-e408-4d1e-bef6-6c5f1f82e06f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:25:14.956803 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e5e7e695-e408-4d1e-bef6-6c5f1f82e06f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:25:14.960612 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:25:14.964357 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5e7e695-e408-4d1e-bef6-6c5f1f82e06f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:14.964848 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5e7e695-e408-4d1e-bef6-6c5f1f82e06f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:14.965307 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5e7e695-e408-4d1e-bef6-6c5f1f82e06f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:14.966034 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5e7e695-e408-4d1e-bef6-6c5f1f82e06f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:14.966543 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5e7e695-e408-4d1e-bef6-6c5f1f82e06f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:14.966973 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e5e7e695-e408-4d1e-bef6-6c5f1f82e06f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:15.101590 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-e5e7e695-e408-4d1e-bef6-6c5f1f82e06f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:25:15.111447 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e5e7e695-e408-4d1e-bef6-6c5f1f82e06f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374" status: 200 len: 1363 microversion: 2.1 time: 0.159697 Sep 04 16:25:15.112031 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 605/1204] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:25:14 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:25:16.136801 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-af641037-4655-4129-83ac-40f0225f02ee tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:25:16.137390 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-af641037-4655-4129-83ac-40f0225f02ee tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:25:16.143936 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-af641037-4655-4129-83ac-40f0225f02ee tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:16.144413 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-af641037-4655-4129-83ac-40f0225f02ee tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:16.144848 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-af641037-4655-4129-83ac-40f0225f02ee tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:16.145540 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-af641037-4655-4129-83ac-40f0225f02ee tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:16.146022 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-af641037-4655-4129-83ac-40f0225f02ee tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:16.146439 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-af641037-4655-4129-83ac-40f0225f02ee tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:16.281876 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-af641037-4655-4129-83ac-40f0225f02ee tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:25:16.289775 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-af641037-4655-4129-83ac-40f0225f02ee tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374" status: 200 len: 1363 microversion: 2.1 time: 0.157374 Sep 04 16:25:16.290354 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 600/1205] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:25:16 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:25:16.996640 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=8 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:25:17.087644 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-2884c43e-e3a5-4f51-8cfa-6fe49031984c req-88bb43c0-5ba7-41a9-80df-1af110d2b686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd0a9170-7b56-4c9a-a918-abd9847f4374", "name": "network-vif-plugged", "status": "completed", "tag": "e695d60e-6b7d-4b70-8196-908884f7dc65"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:25:17.098267 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2884c43e-e3a5-4f51-8cfa-6fe49031984c req-88bb43c0-5ba7-41a9-80df-1af110d2b686 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:17.098736 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2884c43e-e3a5-4f51-8cfa-6fe49031984c req-88bb43c0-5ba7-41a9-80df-1af110d2b686 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:17.099163 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-2884c43e-e3a5-4f51-8cfa-6fe49031984c req-88bb43c0-5ba7-41a9-80df-1af110d2b686 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:17.119939 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-2884c43e-e3a5-4f51-8cfa-6fe49031984c req-88bb43c0-5ba7-41a9-80df-1af110d2b686 service nova] Creating event network-vif-plugged:e695d60e-6b7d-4b70-8196-908884f7dc65 for instance fd0a9170-7b56-4c9a-a918-abd9847f4374 on hv-cinder-85236 Sep 04 16:25:17.124922 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-2884c43e-e3a5-4f51-8cfa-6fe49031984c req-88bb43c0-5ba7-41a9-80df-1af110d2b686 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179296 Sep 04 16:25:17.125510 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 606/1206] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:25:17.312548 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-20bf676f-748c-4281-9351-8a1c2fc240ea tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:25:17.313142 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-20bf676f-748c-4281-9351-8a1c2fc240ea tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:25:17.319679 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20bf676f-748c-4281-9351-8a1c2fc240ea tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:17.320251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20bf676f-748c-4281-9351-8a1c2fc240ea tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:17.320696 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20bf676f-748c-4281-9351-8a1c2fc240ea tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:17.321403 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20bf676f-748c-4281-9351-8a1c2fc240ea tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:17.321891 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20bf676f-748c-4281-9351-8a1c2fc240ea tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:17.322319 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-20bf676f-748c-4281-9351-8a1c2fc240ea tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:17.788419 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-20bf676f-748c-4281-9351-8a1c2fc240ea tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:25:17.796754 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-20bf676f-748c-4281-9351-8a1c2fc240ea tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374" status: 200 len: 1363 microversion: 2.1 time: 0.488234 Sep 04 16:25:17.797335 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 601/1207] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:25:17 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374 => generated 1363 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:25:18.820127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-fa495efc-9f9f-40d2-bfaf-92ea37563ac4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:25:18.820778 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-fa495efc-9f9f-40d2-bfaf-92ea37563ac4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:25:18.827983 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa495efc-9f9f-40d2-bfaf-92ea37563ac4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:18.828461 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa495efc-9f9f-40d2-bfaf-92ea37563ac4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:18.828892 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa495efc-9f9f-40d2-bfaf-92ea37563ac4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:18.829590 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa495efc-9f9f-40d2-bfaf-92ea37563ac4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:18.830054 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa495efc-9f9f-40d2-bfaf-92ea37563ac4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:18.830470 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-fa495efc-9f9f-40d2-bfaf-92ea37563ac4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:18.958286 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-fa495efc-9f9f-40d2-bfaf-92ea37563ac4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:25:18.967342 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-fa495efc-9f9f-40d2-bfaf-92ea37563ac4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374" status: 200 len: 1363 microversion: 2.1 time: 0.151818 Sep 04 16:25:18.968195 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 607/1208] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:25:18 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:25:19.994271 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-fffa66f0-f41b-42d5-b22e-36f183e38a0a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:25:19.994882 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-fffa66f0-f41b-42d5-b22e-36f183e38a0a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:25:19.997578 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=8 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:25:20.011834 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fffa66f0-f41b-42d5-b22e-36f183e38a0a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:20.011834 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fffa66f0-f41b-42d5-b22e-36f183e38a0a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:20.011834 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fffa66f0-f41b-42d5-b22e-36f183e38a0a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:20.011834 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fffa66f0-f41b-42d5-b22e-36f183e38a0a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:20.012218 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fffa66f0-f41b-42d5-b22e-36f183e38a0a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:20.012218 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-fffa66f0-f41b-42d5-b22e-36f183e38a0a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:20.134420 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-fffa66f0-f41b-42d5-b22e-36f183e38a0a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:25:20.143028 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-fffa66f0-f41b-42d5-b22e-36f183e38a0a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374" status: 200 len: 1548 microversion: 2.1 time: 0.152594 Sep 04 16:25:20.143592 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 602/1209] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:25:19 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:25:20.165131 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-aa7003b4-aeed-46f2-b3a1-372477bb4a6e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:25:20.165687 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-aa7003b4-aeed-46f2-b3a1-372477bb4a6e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:25:20.172007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa7003b4-aeed-46f2-b3a1-372477bb4a6e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:20.172489 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa7003b4-aeed-46f2-b3a1-372477bb4a6e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:20.172928 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa7003b4-aeed-46f2-b3a1-372477bb4a6e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:20.173644 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa7003b4-aeed-46f2-b3a1-372477bb4a6e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:20.174104 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa7003b4-aeed-46f2-b3a1-372477bb4a6e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:20.174528 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-aa7003b4-aeed-46f2-b3a1-372477bb4a6e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:20.250398 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-aa7003b4-aeed-46f2-b3a1-372477bb4a6e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089093 Sep 04 16:25:20.250993 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 608/1210] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Sep 4 16:25:20 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:25:21.210909 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-2b1b467d-f45c-4088-a269-3f0c994e015f req-8fa7c3a8-2d20-453c-b4e5-90351deb2514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd0a9170-7b56-4c9a-a918-abd9847f4374", "tag": "e695d60e-6b7d-4b70-8196-908884f7dc65"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:25:21.220803 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-2b1b467d-f45c-4088-a269-3f0c994e015f req-8fa7c3a8-2d20-453c-b4e5-90351deb2514 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:21.221272 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-2b1b467d-f45c-4088-a269-3f0c994e015f req-8fa7c3a8-2d20-453c-b4e5-90351deb2514 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:21.221733 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-2b1b467d-f45c-4088-a269-3f0c994e015f req-8fa7c3a8-2d20-453c-b4e5-90351deb2514 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:21.233536 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-2b1b467d-f45c-4088-a269-3f0c994e015f req-8fa7c3a8-2d20-453c-b4e5-90351deb2514 service nova] Creating event network-changed:e695d60e-6b7d-4b70-8196-908884f7dc65 for instance fd0a9170-7b56-4c9a-a918-abd9847f4374 on hv-cinder-85236 Sep 04 16:25:21.238654 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-2b1b467d-f45c-4088-a269-3f0c994e015f req-8fa7c3a8-2d20-453c-b4e5-90351deb2514 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031328 Sep 04 16:25:21.239989 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 603/1211] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:25:55.331963 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=11 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:25:55.332720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=25 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:25:55.336990 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-e19440b3-3b82-477b-83b8-e5ff489b5a49 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:25:55.337494 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-e19440b3-3b82-477b-83b8-e5ff489b5a49 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:25:55.344283 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e19440b3-3b82-477b-83b8-e5ff489b5a49 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:55.353612 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e19440b3-3b82-477b-83b8-e5ff489b5a49 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:55.353612 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e19440b3-3b82-477b-83b8-e5ff489b5a49 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:55.353612 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e19440b3-3b82-477b-83b8-e5ff489b5a49 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:55.353612 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e19440b3-3b82-477b-83b8-e5ff489b5a49 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:55.354029 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-e19440b3-3b82-477b-83b8-e5ff489b5a49 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:55.369503 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-e19440b3-3b82-477b-83b8-e5ff489b5a49 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/ips" status: 200 len: 144 microversion: 2.1 time: 0.039039 Sep 04 16:25:55.370112 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 609/1212] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Sep 4 16:25:55 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/ips => generated 144 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:25:56.878523 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=13 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:25:56.879299 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=31 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:25:56.880392 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 04 16:25:56.880526 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Sun Sep 4 16:25:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/os-volume_attachments (ip 10.222.0.39) !!! Sep 04 16:25:56.885124 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-22a7c933-9a02-41ca-a247-d996f67219c8 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "243e4d13-5537-4bf0-87c0-55b78dc77e64"}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:25:56.887671 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-22a7c933-9a02-41ca-a247-d996f67219c8 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:25:56.895381 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-22a7c933-9a02-41ca-a247-d996f67219c8 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:56.900891 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-22a7c933-9a02-41ca-a247-d996f67219c8 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:56.900891 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-22a7c933-9a02-41ca-a247-d996f67219c8 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:56.900891 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-22a7c933-9a02-41ca-a247-d996f67219c8 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:25:56.900891 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-22a7c933-9a02-41ca-a247-d996f67219c8 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:25:56.901282 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-22a7c933-9a02-41ca-a247-d996f67219c8 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:25:57.626782 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-22a7c933-9a02-41ca-a247-d996f67219c8 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "POST /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.749500 Sep 04 16:25:57.627300 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 604/1213] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Sep 4 16:25:56 2022] POST /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/os-volume_attachments => generated 194 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:26:05.162486 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-495369d6-f2c6-4687-b70c-0e6c2ec8aa3d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:26:05.164629 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-495369d6-f2c6-4687-b70c-0e6c2ec8aa3d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:26:05.171769 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-495369d6-f2c6-4687-b70c-0e6c2ec8aa3d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:05.172251 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-495369d6-f2c6-4687-b70c-0e6c2ec8aa3d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:05.172690 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-495369d6-f2c6-4687-b70c-0e6c2ec8aa3d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:05.173380 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-495369d6-f2c6-4687-b70c-0e6c2ec8aa3d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:05.173883 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-495369d6-f2c6-4687-b70c-0e6c2ec8aa3d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:05.174306 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-495369d6-f2c6-4687-b70c-0e6c2ec8aa3d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:05.205419 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-495369d6-f2c6-4687-b70c-0e6c2ec8aa3d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047520 Sep 04 16:26:05.206000 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 610/1214] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:26:05 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:26:05.218574 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-99cd3f38-42ab-40cd-af8e-528c99b6a1bc tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:26:05.219169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-99cd3f38-42ab-40cd-af8e-528c99b6a1bc tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:26:05.225829 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99cd3f38-42ab-40cd-af8e-528c99b6a1bc tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:05.226428 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99cd3f38-42ab-40cd-af8e-528c99b6a1bc tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:05.226938 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99cd3f38-42ab-40cd-af8e-528c99b6a1bc tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:05.227639 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99cd3f38-42ab-40cd-af8e-528c99b6a1bc tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:05.228082 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99cd3f38-42ab-40cd-af8e-528c99b6a1bc tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:05.228498 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-99cd3f38-42ab-40cd-af8e-528c99b6a1bc tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:05.258929 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-99cd3f38-42ab-40cd-af8e-528c99b6a1bc tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/os-volume_attachments/243e4d13-5537-4bf0-87c0-55b78dc77e64" status: 200 len: 194 microversion: 2.1 time: 0.045842 Sep 04 16:26:05.259523 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 605/1215] 10.222.0.39 () {58 vars in 1413 bytes} [Sun Sep 4 16:26:05 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/os-volume_attachments/243e4d13-5537-4bf0-87c0-55b78dc77e64 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:26:06.818942 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1d565228-d265-4572-b5cd-08c39f824a31 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acb7b817-eb7d-496b-8aa8-3748e5df00e7"}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:26:06.821261 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1d565228-d265-4572-b5cd-08c39f824a31 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:26:06.828353 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d565228-d265-4572-b5cd-08c39f824a31 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:06.829179 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d565228-d265-4572-b5cd-08c39f824a31 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:06.829891 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d565228-d265-4572-b5cd-08c39f824a31 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:06.831004 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d565228-d265-4572-b5cd-08c39f824a31 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:06.831789 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d565228-d265-4572-b5cd-08c39f824a31 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:06.832548 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-1d565228-d265-4572-b5cd-08c39f824a31 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:07.627218 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1d565228-d265-4572-b5cd-08c39f824a31 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "POST /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.812050 Sep 04 16:26:07.627821 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 611/1216] 10.222.0.39 () {60 vars in 1323 bytes} [Sun Sep 4 16:26:06 2022] POST /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/os-volume_attachments => generated 194 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:26:15.173021 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-978261b3-b244-4966-9534-408a6ca11e38 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:26:15.179029 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-978261b3-b244-4966-9534-408a6ca11e38 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:26:15.182966 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-978261b3-b244-4966-9534-408a6ca11e38 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:15.183449 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-978261b3-b244-4966-9534-408a6ca11e38 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:15.183886 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-978261b3-b244-4966-9534-408a6ca11e38 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:15.184580 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-978261b3-b244-4966-9534-408a6ca11e38 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:15.185028 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-978261b3-b244-4966-9534-408a6ca11e38 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:15.185447 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-978261b3-b244-4966-9534-408a6ca11e38 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:15.214708 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-978261b3-b244-4966-9534-408a6ca11e38 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047220 Sep 04 16:26:15.215258 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 606/1217] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:26:15 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:26:15.363194 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-03df3d6d-f273-496e-a933-219ba5da65b4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:26:15.363774 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-03df3d6d-f273-496e-a933-219ba5da65b4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:26:15.369987 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03df3d6d-f273-496e-a933-219ba5da65b4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:15.370470 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03df3d6d-f273-496e-a933-219ba5da65b4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:15.370905 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03df3d6d-f273-496e-a933-219ba5da65b4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:15.371595 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03df3d6d-f273-496e-a933-219ba5da65b4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:15.372045 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03df3d6d-f273-496e-a933-219ba5da65b4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:15.372468 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-03df3d6d-f273-496e-a933-219ba5da65b4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:15.401782 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-03df3d6d-f273-496e-a933-219ba5da65b4 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/os-volume_attachments/243e4d13-5537-4bf0-87c0-55b78dc77e64" status: 200 len: 194 microversion: 2.1 time: 0.044312 Sep 04 16:26:15.402355 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 612/1218] 10.222.0.39 () {58 vars in 1413 bytes} [Sun Sep 4 16:26:15 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/os-volume_attachments/243e4d13-5537-4bf0-87c0-55b78dc77e64 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:26:15.413906 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-42010fbc-cb37-4d8f-a65c-e0a4e800b72f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:26:15.414408 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-42010fbc-cb37-4d8f-a65c-e0a4e800b72f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:26:15.421171 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-42010fbc-cb37-4d8f-a65c-e0a4e800b72f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:15.421684 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-42010fbc-cb37-4d8f-a65c-e0a4e800b72f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:15.422114 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-42010fbc-cb37-4d8f-a65c-e0a4e800b72f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:15.422789 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-42010fbc-cb37-4d8f-a65c-e0a4e800b72f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:15.423234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-42010fbc-cb37-4d8f-a65c-e0a4e800b72f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:15.423650 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-42010fbc-cb37-4d8f-a65c-e0a4e800b72f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:15.505079 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-42010fbc-cb37-4d8f-a65c-e0a4e800b72f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lazy-loading 'services' on Instance uuid fd0a9170-7b56-4c9a-a918-abd9847f4374 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:26:15.685100 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-42010fbc-cb37-4d8f-a65c-e0a4e800b72f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/os-volume_attachments/243e4d13-5537-4bf0-87c0-55b78dc77e64" status: 202 len: 0 microversion: 2.1 time: 0.275125 Sep 04 16:26:15.686675 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 607/1219] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Sep 4 16:26:15 2022] DELETE /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/os-volume_attachments/243e4d13-5537-4bf0-87c0-55b78dc77e64 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:26:16.809478 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a9095c7e-e9af-4f01-8f66-1be2258ff14b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:26:16.810045 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a9095c7e-e9af-4f01-8f66-1be2258ff14b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:26:16.817167 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9095c7e-e9af-4f01-8f66-1be2258ff14b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:16.817674 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9095c7e-e9af-4f01-8f66-1be2258ff14b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:16.818106 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9095c7e-e9af-4f01-8f66-1be2258ff14b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:16.818784 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9095c7e-e9af-4f01-8f66-1be2258ff14b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:16.819228 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9095c7e-e9af-4f01-8f66-1be2258ff14b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:16.819641 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a9095c7e-e9af-4f01-8f66-1be2258ff14b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:16.849246 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a9095c7e-e9af-4f01-8f66-1be2258ff14b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/os-volume_attachments/acb7b817-eb7d-496b-8aa8-3748e5df00e7" status: 200 len: 194 microversion: 2.1 time: 0.043719 Sep 04 16:26:16.849865 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 613/1220] 10.222.0.39 () {58 vars in 1413 bytes} [Sun Sep 4 16:26:16 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/os-volume_attachments/acb7b817-eb7d-496b-8aa8-3748e5df00e7 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:26:16.861652 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f9a5cb83-d72d-4868-bc6b-f775d93d7063 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:26:16.864099 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f9a5cb83-d72d-4868-bc6b-f775d93d7063 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:26:16.868512 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f9a5cb83-d72d-4868-bc6b-f775d93d7063 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:16.868994 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f9a5cb83-d72d-4868-bc6b-f775d93d7063 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:16.869459 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f9a5cb83-d72d-4868-bc6b-f775d93d7063 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:16.870176 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f9a5cb83-d72d-4868-bc6b-f775d93d7063 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:16.870631 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f9a5cb83-d72d-4868-bc6b-f775d93d7063 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:16.871055 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f9a5cb83-d72d-4868-bc6b-f775d93d7063 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:16.954921 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-f9a5cb83-d72d-4868-bc6b-f775d93d7063 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lazy-loading 'services' on Instance uuid fd0a9170-7b56-4c9a-a918-abd9847f4374 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:26:17.119639 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f9a5cb83-d72d-4868-bc6b-f775d93d7063 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/os-volume_attachments/acb7b817-eb7d-496b-8aa8-3748e5df00e7" status: 202 len: 0 microversion: 2.1 time: 0.262793 Sep 04 16:26:17.120247 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 608/1221] 10.222.0.39 () {58 vars in 1416 bytes} [Sun Sep 4 16:26:16 2022] DELETE /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/os-volume_attachments/acb7b817-eb7d-496b-8aa8-3748e5df00e7 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:26:18.306555 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a84b1928-8d59-47fc-989f-116702ac576b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:26:18.308794 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a84b1928-8d59-47fc-989f-116702ac576b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:26:18.315938 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a84b1928-8d59-47fc-989f-116702ac576b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:18.316424 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a84b1928-8d59-47fc-989f-116702ac576b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:18.316871 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a84b1928-8d59-47fc-989f-116702ac576b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:18.317585 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a84b1928-8d59-47fc-989f-116702ac576b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:18.318049 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a84b1928-8d59-47fc-989f-116702ac576b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:18.318474 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-a84b1928-8d59-47fc-989f-116702ac576b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:18.348556 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a84b1928-8d59-47fc-989f-116702ac576b tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045914 Sep 04 16:26:18.349117 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 614/1222] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:26:18 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 04 16:26:18.466046 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-8e3c7a44-b2e1-45a2-8e2c-66166275402a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:26:18.468798 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-8e3c7a44-b2e1-45a2-8e2c-66166275402a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:26:18.475118 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8e3c7a44-b2e1-45a2-8e2c-66166275402a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:18.475597 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8e3c7a44-b2e1-45a2-8e2c-66166275402a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:18.476027 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8e3c7a44-b2e1-45a2-8e2c-66166275402a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:18.476710 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8e3c7a44-b2e1-45a2-8e2c-66166275402a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:18.477210 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8e3c7a44-b2e1-45a2-8e2c-66166275402a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:18.477636 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-8e3c7a44-b2e1-45a2-8e2c-66166275402a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:18.508250 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-8e3c7a44-b2e1-45a2-8e2c-66166275402a tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047074 Sep 04 16:26:18.508798 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 609/1223] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Sep 4 16:26:18 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 04 16:26:18.574191 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-c94161ad-5cc1-45e9-9c12-7153eceaee84 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:26:18.574692 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c94161ad-5cc1-45e9-9c12-7153eceaee84 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:26:18.582694 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c94161ad-5cc1-45e9-9c12-7153eceaee84 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:18.583545 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c94161ad-5cc1-45e9-9c12-7153eceaee84 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:18.584328 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c94161ad-5cc1-45e9-9c12-7153eceaee84 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:18.585607 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c94161ad-5cc1-45e9-9c12-7153eceaee84 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:18.586082 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c94161ad-5cc1-45e9-9c12-7153eceaee84 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:18.586518 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-c94161ad-5cc1-45e9-9c12-7153eceaee84 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:18.618688 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-c94161ad-5cc1-45e9-9c12-7153eceaee84 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 16:26:18.829096 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-c94161ad-5cc1-45e9-9c12-7153eceaee84 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374" status: 204 len: 0 microversion: 2.1 time: 0.258671 Sep 04 16:26:18.829629 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 615/1224] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:26:18 2022] DELETE /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 16:26:18.837859 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4a3c1a17-29fe-43c9-b1ba-21caab96ab40 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:26:18.839815 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4a3c1a17-29fe-43c9-b1ba-21caab96ab40 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:26:18.846502 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4a3c1a17-29fe-43c9-b1ba-21caab96ab40 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:18.847013 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4a3c1a17-29fe-43c9-b1ba-21caab96ab40 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:18.847454 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4a3c1a17-29fe-43c9-b1ba-21caab96ab40 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:18.848150 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4a3c1a17-29fe-43c9-b1ba-21caab96ab40 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:18.848604 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4a3c1a17-29fe-43c9-b1ba-21caab96ab40 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:18.854693 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4a3c1a17-29fe-43c9-b1ba-21caab96ab40 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:18.993439 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-4a3c1a17-29fe-43c9-b1ba-21caab96ab40 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:26:19.001357 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4a3c1a17-29fe-43c9-b1ba-21caab96ab40 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374" status: 200 len: 1672 microversion: 2.1 time: 0.167472 Sep 04 16:26:19.001933 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 610/1225] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:26:18 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:26:20.025076 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-9b89c30a-b116-4d07-9535-49e2cf1e758f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:26:20.025816 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-9b89c30a-b116-4d07-9535-49e2cf1e758f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:26:20.032505 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b89c30a-b116-4d07-9535-49e2cf1e758f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:20.032971 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b89c30a-b116-4d07-9535-49e2cf1e758f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:20.033398 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b89c30a-b116-4d07-9535-49e2cf1e758f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:20.034368 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b89c30a-b116-4d07-9535-49e2cf1e758f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:20.034815 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b89c30a-b116-4d07-9535-49e2cf1e758f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:20.035229 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-9b89c30a-b116-4d07-9535-49e2cf1e758f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:20.162867 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-9b89c30a-b116-4d07-9535-49e2cf1e758f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:26:20.171268 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-9b89c30a-b116-4d07-9535-49e2cf1e758f tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374" status: 200 len: 1672 microversion: 2.1 time: 0.150384 Sep 04 16:26:20.171825 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 616/1226] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:26:20 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374 => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:26:21.195694 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-3b1972cf-7e62-40a1-b744-40c5723bb9ca tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:26:21.196250 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-3b1972cf-7e62-40a1-b744-40c5723bb9ca tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:26:21.202922 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b1972cf-7e62-40a1-b744-40c5723bb9ca tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:21.203591 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b1972cf-7e62-40a1-b744-40c5723bb9ca tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:21.204088 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b1972cf-7e62-40a1-b744-40c5723bb9ca tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:21.204782 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b1972cf-7e62-40a1-b744-40c5723bb9ca tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:21.205229 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b1972cf-7e62-40a1-b744-40c5723bb9ca tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:21.205672 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-3b1972cf-7e62-40a1-b744-40c5723bb9ca tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:21.276455 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-3b1972cf-7e62-40a1-b744-40c5723bb9ca tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:26:21.284821 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-3b1972cf-7e62-40a1-b744-40c5723bb9ca tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374" status: 200 len: 1604 microversion: 2.1 time: 0.093338 Sep 04 16:26:21.285403 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 611/1227] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:26:21 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374 => generated 1604 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:26:21.441684 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-60f6a27d-33cf-4f65-967d-688b77216b51 req-63b5bfd5-eecf-4fdd-8ceb-fb3cea36b4cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd0a9170-7b56-4c9a-a918-abd9847f4374", "name": "network-vif-deleted", "tag": "e695d60e-6b7d-4b70-8196-908884f7dc65"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:26:21.453274 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-60f6a27d-33cf-4f65-967d-688b77216b51 req-63b5bfd5-eecf-4fdd-8ceb-fb3cea36b4cb service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:21.453703 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-60f6a27d-33cf-4f65-967d-688b77216b51 req-63b5bfd5-eecf-4fdd-8ceb-fb3cea36b4cb service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:21.454144 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-60f6a27d-33cf-4f65-967d-688b77216b51 req-63b5bfd5-eecf-4fdd-8ceb-fb3cea36b4cb service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:21.466263 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-60f6a27d-33cf-4f65-967d-688b77216b51 req-63b5bfd5-eecf-4fdd-8ceb-fb3cea36b4cb service nova] Creating event network-vif-deleted:e695d60e-6b7d-4b70-8196-908884f7dc65 for instance fd0a9170-7b56-4c9a-a918-abd9847f4374 on hv-cinder-85236 Sep 04 16:26:21.484390 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-60f6a27d-33cf-4f65-967d-688b77216b51 req-63b5bfd5-eecf-4fdd-8ceb-fb3cea36b4cb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035274 Sep 04 16:26:21.484390 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 617/1228] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:26:22.307769 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b07bdf00-e1bb-4bac-af7b-1e664ef65e25 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:26:22.308377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b07bdf00-e1bb-4bac-af7b-1e664ef65e25 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:26:22.315334 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b07bdf00-e1bb-4bac-af7b-1e664ef65e25 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:22.315765 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b07bdf00-e1bb-4bac-af7b-1e664ef65e25 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:22.316179 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b07bdf00-e1bb-4bac-af7b-1e664ef65e25 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:22.316900 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b07bdf00-e1bb-4bac-af7b-1e664ef65e25 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:22.317349 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b07bdf00-e1bb-4bac-af7b-1e664ef65e25 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:22.317794 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b07bdf00-e1bb-4bac-af7b-1e664ef65e25 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:22.354636 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b07bdf00-e1bb-4bac-af7b-1e664ef65e25 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:22.355113 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b07bdf00-e1bb-4bac-af7b-1e664ef65e25 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:22.355544 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b07bdf00-e1bb-4bac-af7b-1e664ef65e25 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:22.355985 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-b07bdf00-e1bb-4bac-af7b-1e664ef65e25 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lazy-loading 'fault' on Instance uuid fd0a9170-7b56-4c9a-a918-abd9847f4374 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:26:22.397410 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b07bdf00-e1bb-4bac-af7b-1e664ef65e25 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1fa7bf738264e77b868ce9d7863214e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dde43a19e95472d87ea4273922156be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:26:22.405807 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b07bdf00-e1bb-4bac-af7b-1e664ef65e25 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374" status: 200 len: 1327 microversion: 2.1 time: 0.102046 Sep 04 16:26:22.406382 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 612/1229] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:26:22 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374 => generated 1327 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:26:23.430892 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-97aea9ea-5740-4b79-88cc-27e49a040e28 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:26:23.431498 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-97aea9ea-5740-4b79-88cc-27e49a040e28 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:26:23.441054 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-97aea9ea-5740-4b79-88cc-27e49a040e28 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:23.441552 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-97aea9ea-5740-4b79-88cc-27e49a040e28 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:23.442400 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-97aea9ea-5740-4b79-88cc-27e49a040e28 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:23.443099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-97aea9ea-5740-4b79-88cc-27e49a040e28 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:23.443561 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-97aea9ea-5740-4b79-88cc-27e49a040e28 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:23.443988 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-97aea9ea-5740-4b79-88cc-27e49a040e28 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:23.458402 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-97aea9ea-5740-4b79-88cc-27e49a040e28 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] HTTP exception thrown: Instance fd0a9170-7b56-4c9a-a918-abd9847f4374 could not be found. Sep 04 16:26:23.460067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-97aea9ea-5740-4b79-88cc-27e49a040e28 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Request method failure captured: Sep 04 16:26:23.460067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374 HTTP/1.1 Sep 04 16:26:23.460067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:26:23.460067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:26:23.460067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:26:23.460067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 04 16:26:23.460067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:26:23.460067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:26:23.460067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:26:23.460067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:26:23.460067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFNCwPsNLOqN2R5acwUcgKonlmm3BbYspMprQDepoYiAKqsgcY0hWq1GQH0V6RDSl1H50EN9w3S3YJ1owauf9S8NF20RJCbKN3aPByDtXZET8XrEHAvUTpj8oqI4-3yM6ObAYjlMZRjVmUNVqlYPNPizaD1JNxJUqixh2SfB9WVMaRZY Sep 04 16:26:23.460067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:26:23.460067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:26:23.460067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:26:23.460067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:26:23.460067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:26:23.460067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:26:23.460067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: 6dde43a19e95472d87ea4273922156be Sep 04 16:26:23.460067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeTestJSON-1717945144 Sep 04 16:26:23.460067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:26:23.460067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:26:23.474364 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6dde43a19e95472d87ea4273922156be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6dde43a19e95472d87ea4273922156be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6dde43a19e95472d87ea4273922156be", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6dde43a19e95472d87ea4273922156be"}]}] Sep 04 16:26:23.474364 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeTestJSON-1717945144 Sep 04 16:26:23.474364 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: 6dde43a19e95472d87ea4273922156be Sep 04 16:26:23.474364 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1717945144 Sep 04 16:26:23.474364 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-AttachVolumeTestJSON-1717945144-project Sep 04 16:26:23.474364 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:26:23.474364 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:26:23.474364 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: b1fa7bf738264e77b868ce9d7863214e Sep 04 16:26:23.474364 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeTestJSON-1717945144-project Sep 04 16:26:23.474364 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: > Sep 04 16:26:23.474364 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Instance fd0a9170-7b56-4c9a-a918-abd9847f4374 could not be found. Sep 04 16:26:23.474364 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'id': 'fd0a9170-7b56-4c9a-a918-abd9847f4374'} Sep 04 16:26:23.475348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:26:23.475348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:26:23.475348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:26:23.475348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:26:23.475348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:26:23.475348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:26:23.475348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:26:23.475348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:26:23.475348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:26:23.475348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:26:23.475348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd0a9170-7b56-4c9a-a918-abd9847f4374 could not be found. Sep 04 16:26:23.475348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:26:23.475348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:26:23.475348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:26:23.475348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:26:23.475348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:26:23.475348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:26:23.475348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:26:23.475348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:26:23.475348 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:26:23.476931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:26:23.476931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:26:23.476931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:26:23.476931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:26:23.476931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:26:23.476931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:26:23.476931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:26:23.476931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd0a9170-7b56-4c9a-a918-abd9847f4374 could not be found. Sep 04 16:26:23.476931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:26:23.476931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:26:23.476931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:26:23.476931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:26:23.476931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:26:23.476931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:26:23.476931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:26:23.476931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:26:23.476931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd0a9170-7b56-4c9a-a918-abd9847f4374 could not be found. Sep 04 16:26:23.476931 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:26:23.478391 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-97aea9ea-5740-4b79-88cc-27e49a040e28 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Returning 404 to user: Instance fd0a9170-7b56-4c9a-a918-abd9847f4374 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:26:23.478391 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-97aea9ea-5740-4b79-88cc-27e49a040e28 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374" status: 404 len: 111 microversion: 2.1 time: 0.035381 Sep 04 16:26:23.478391 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 618/1230] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:26:23 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:26:23.478649 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9bc64b6a-6821-4c69-8a36-0bae3271d961 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '.version_select at 0x7f9689341a60>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:26:23.572642 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9bc64b6a-6821-4c69-8a36-0bae3271d961 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1355232508" status: 202 len: 0 microversion: 2.1 time: 0.106190 Sep 04 16:26:23.573320 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 613/1231] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Sep 4 16:26:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1355232508 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 04 16:26:26.812208 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-92f2f14c-1bdf-4ed8-9d0d-2f9586fe03df tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:26:26.812686 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-92f2f14c-1bdf-4ed8-9d0d-2f9586fe03df tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:26:26.819007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92f2f14c-1bdf-4ed8-9d0d-2f9586fe03df tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:26.819480 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92f2f14c-1bdf-4ed8-9d0d-2f9586fe03df tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:26.819912 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92f2f14c-1bdf-4ed8-9d0d-2f9586fe03df tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:26.820587 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92f2f14c-1bdf-4ed8-9d0d-2f9586fe03df tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:26.821033 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92f2f14c-1bdf-4ed8-9d0d-2f9586fe03df tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:26.821448 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-92f2f14c-1bdf-4ed8-9d0d-2f9586fe03df tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:26.836491 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-92f2f14c-1bdf-4ed8-9d0d-2f9586fe03df tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] HTTP exception thrown: Instance fd0a9170-7b56-4c9a-a918-abd9847f4374 could not be found. Sep 04 16:26:26.838158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-92f2f14c-1bdf-4ed8-9d0d-2f9586fe03df tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Request method failure captured: Sep 04 16:26:26.838158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374 HTTP/1.1 Sep 04 16:26:26.838158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:26:26.838158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:26:26.838158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:26:26.838158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 04 16:26:26.838158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:26:26.838158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:26:26.838158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:26:26.838158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:26:26.838158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFNCwPsNLOqN2R5acwUcgKonlmm3BbYspMprQDepoYiAKqsgcY0hWq1GQH0V6RDSl1H50EN9w3S3YJ1owauf9S8NF20RJCbKN3aPByDtXZET8XrEHAvUTpj8oqI4-3yM6ObAYjlMZRjVmUNVqlYPNPizaD1JNxJUqixh2SfB9WVMaRZY Sep 04 16:26:26.838158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:26:26.838158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:26:26.838158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:26:26.838158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:26:26.838158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:26:26.838158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:26:26.838158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: 6dde43a19e95472d87ea4273922156be Sep 04 16:26:26.838158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeTestJSON-1717945144 Sep 04 16:26:26.838158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:26:26.838158 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:26:26.839855 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6dde43a19e95472d87ea4273922156be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6dde43a19e95472d87ea4273922156be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6dde43a19e95472d87ea4273922156be", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6dde43a19e95472d87ea4273922156be"}]}] Sep 04 16:26:26.839855 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeTestJSON-1717945144 Sep 04 16:26:26.839855 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: 6dde43a19e95472d87ea4273922156be Sep 04 16:26:26.839855 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1717945144 Sep 04 16:26:26.839855 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-AttachVolumeTestJSON-1717945144-project Sep 04 16:26:26.839855 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:26:26.839855 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:26:26.839855 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: b1fa7bf738264e77b868ce9d7863214e Sep 04 16:26:26.839855 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeTestJSON-1717945144-project Sep 04 16:26:26.839855 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: > Sep 04 16:26:26.839855 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Instance fd0a9170-7b56-4c9a-a918-abd9847f4374 could not be found. Sep 04 16:26:26.839855 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'id': 'fd0a9170-7b56-4c9a-a918-abd9847f4374'} Sep 04 16:26:26.840720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:26:26.840720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:26:26.840720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:26:26.840720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:26:26.840720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:26:26.840720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:26:26.840720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:26:26.840720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:26:26.840720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:26:26.840720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:26:26.840720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd0a9170-7b56-4c9a-a918-abd9847f4374 could not be found. Sep 04 16:26:26.840720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:26:26.840720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:26:26.840720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:26:26.840720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:26:26.840720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:26:26.840720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:26:26.840720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:26:26.840720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:26:26.840720 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:26:26.842431 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:26:26.842431 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 04 16:26:26.842431 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 04 16:26:26.842431 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 04 16:26:26.842431 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 04 16:26:26.842431 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:26:26.842431 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:26:26.842431 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:26:26.842431 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:26:26.842431 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd0a9170-7b56-4c9a-a918-abd9847f4374 could not be found. Sep 04 16:26:26.842431 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:26:26.842431 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:26:26.842431 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:26:26.842431 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:26:26.842431 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:26:26.842431 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:26:26.842431 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:26:26.842431 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:26:26.842431 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd0a9170-7b56-4c9a-a918-abd9847f4374 could not be found. Sep 04 16:26:26.842431 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:26:26.843749 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-92f2f14c-1bdf-4ed8-9d0d-2f9586fe03df tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Returning 404 to user: Instance fd0a9170-7b56-4c9a-a918-abd9847f4374 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:26:26.843749 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-92f2f14c-1bdf-4ed8-9d0d-2f9586fe03df tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374" status: 404 len: 111 microversion: 2.1 time: 0.031849 Sep 04 16:26:26.843749 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 619/1232] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:26:26 2022] DELETE /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:26:26.847890 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-60c64c24-c315-4263-a232-1d0559ee669d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:26:26.848497 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-60c64c24-c315-4263-a232-1d0559ee669d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: fd0a9170-7b56-4c9a-a918-abd9847f4374] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:26:26.855631 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-60c64c24-c315-4263-a232-1d0559ee669d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:26.856111 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-60c64c24-c315-4263-a232-1d0559ee669d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:26.856543 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-60c64c24-c315-4263-a232-1d0559ee669d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:26.857771 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-60c64c24-c315-4263-a232-1d0559ee669d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:26.858215 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-60c64c24-c315-4263-a232-1d0559ee669d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:26.858641 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-60c64c24-c315-4263-a232-1d0559ee669d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:26.877732 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-60c64c24-c315-4263-a232-1d0559ee669d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] HTTP exception thrown: Instance fd0a9170-7b56-4c9a-a918-abd9847f4374 could not be found. Sep 04 16:26:26.879377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-60c64c24-c315-4263-a232-1d0559ee669d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Request method failure captured: Sep 04 16:26:26.879377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374 HTTP/1.1 Sep 04 16:26:26.879377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:26:26.879377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:26:26.879377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:26:26.879377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:26:26.879377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:26:26.879377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:26:26.879377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:26:26.879377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:26:26.879377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFNCwPsNLOqN2R5acwUcgKonlmm3BbYspMprQDepoYiAKqsgcY0hWq1GQH0V6RDSl1H50EN9w3S3YJ1owauf9S8NF20RJCbKN3aPByDtXZET8XrEHAvUTpj8oqI4-3yM6ObAYjlMZRjVmUNVqlYPNPizaD1JNxJUqixh2SfB9WVMaRZY Sep 04 16:26:26.879377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:26:26.879377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:26:26.879377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:26:26.879377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:26:26.879377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:26:26.879377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:26:26.879377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: 6dde43a19e95472d87ea4273922156be Sep 04 16:26:26.879377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeTestJSON-1717945144 Sep 04 16:26:26.879377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:26:26.879377 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:26:26.881032 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6dde43a19e95472d87ea4273922156be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6dde43a19e95472d87ea4273922156be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6dde43a19e95472d87ea4273922156be", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6dde43a19e95472d87ea4273922156be"}]}] Sep 04 16:26:26.881032 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeTestJSON-1717945144 Sep 04 16:26:26.881032 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 6dde43a19e95472d87ea4273922156be Sep 04 16:26:26.881032 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1717945144 Sep 04 16:26:26.881032 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeTestJSON-1717945144-project Sep 04 16:26:26.881032 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:26:26.881032 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:26:26.881032 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: b1fa7bf738264e77b868ce9d7863214e Sep 04 16:26:26.881032 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeTestJSON-1717945144-project Sep 04 16:26:26.881032 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: > Sep 04 16:26:26.881032 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Instance fd0a9170-7b56-4c9a-a918-abd9847f4374 could not be found. Sep 04 16:26:26.881032 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': 'fd0a9170-7b56-4c9a-a918-abd9847f4374'} Sep 04 16:26:26.882047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:26:26.882047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:26:26.882047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:26:26.882047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:26:26.882047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:26:26.882047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:26:26.882047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:26:26.882047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:26:26.882047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:26:26.882047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:26:26.882047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd0a9170-7b56-4c9a-a918-abd9847f4374 could not be found. Sep 04 16:26:26.882047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:26:26.882047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:26:26.882047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:26:26.882047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:26:26.882047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:26:26.882047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:26:26.882047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:26:26.882047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:26:26.882047 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:26:26.883632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:26:26.883632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:26:26.883632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:26:26.883632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:26:26.883632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:26:26.883632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:26:26.883632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:26:26.883632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd0a9170-7b56-4c9a-a918-abd9847f4374 could not be found. Sep 04 16:26:26.883632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:26:26.883632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:26:26.883632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:26:26.883632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:26:26.883632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:26:26.883632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:26:26.883632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:26:26.883632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:26:26.883632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd0a9170-7b56-4c9a-a918-abd9847f4374 could not be found. Sep 04 16:26:26.883632 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:26:26.885185 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-60c64c24-c315-4263-a232-1d0559ee669d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Returning 404 to user: Instance fd0a9170-7b56-4c9a-a918-abd9847f4374 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:26:26.885185 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-60c64c24-c315-4263-a232-1d0559ee669d tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374" status: 404 len: 111 microversion: 2.1 time: 0.036750 Sep 04 16:26:26.885185 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 614/1233] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:26:26 2022] GET /compute/v2.1/servers/fd0a9170-7b56-4c9a-a918-abd9847f4374 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:26:28.167373 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8b62bfe9-b0b8-42de-ade8-cdd82f06078e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:26:28.167873 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-8b62bfe9-b0b8-42de-ade8-cdd82f06078e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:26:28.174783 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b62bfe9-b0b8-42de-ade8-cdd82f06078e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:28.175260 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b62bfe9-b0b8-42de-ade8-cdd82f06078e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:28.175698 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b62bfe9-b0b8-42de-ade8-cdd82f06078e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:28.176383 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b62bfe9-b0b8-42de-ade8-cdd82f06078e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:28.176837 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b62bfe9-b0b8-42de-ade8-cdd82f06078e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:28.177265 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-8b62bfe9-b0b8-42de-ade8-cdd82f06078e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:28.191457 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-8b62bfe9-b0b8-42de-ade8-cdd82f06078e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] HTTP exception thrown: Instance b4ab95ba-6b1d-482f-9160-c25b0c3ba82b could not be found. Sep 04 16:26:28.192975 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8b62bfe9-b0b8-42de-ade8-cdd82f06078e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Request method failure captured: Sep 04 16:26:28.192975 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: DELETE /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b HTTP/1.1 Sep 04 16:26:28.192975 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:26:28.192975 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:26:28.192975 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:26:28.192975 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 04 16:26:28.192975 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:26:28.192975 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:26:28.192975 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:26:28.192975 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:26:28.192975 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFNCwPsNLOqN2R5acwUcgKonlmm3BbYspMprQDepoYiAKqsgcY0hWq1GQH0V6RDSl1H50EN9w3S3YJ1owauf9S8NF20RJCbKN3aPByDtXZET8XrEHAvUTpj8oqI4-3yM6ObAYjlMZRjVmUNVqlYPNPizaD1JNxJUqixh2SfB9WVMaRZY Sep 04 16:26:28.192975 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:26:28.192975 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:26:28.192975 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:26:28.192975 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:26:28.192975 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:26:28.192975 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:26:28.192975 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: 6dde43a19e95472d87ea4273922156be Sep 04 16:26:28.192975 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-AttachVolumeTestJSON-1717945144 Sep 04 16:26:28.192975 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:26:28.192975 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:26:28.194669 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6dde43a19e95472d87ea4273922156be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6dde43a19e95472d87ea4273922156be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6dde43a19e95472d87ea4273922156be", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6dde43a19e95472d87ea4273922156be"}]}] Sep 04 16:26:28.194669 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-AttachVolumeTestJSON-1717945144 Sep 04 16:26:28.194669 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: 6dde43a19e95472d87ea4273922156be Sep 04 16:26:28.194669 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1717945144 Sep 04 16:26:28.194669 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-AttachVolumeTestJSON-1717945144-project Sep 04 16:26:28.194669 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:26:28.194669 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:26:28.194669 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: b1fa7bf738264e77b868ce9d7863214e Sep 04 16:26:28.194669 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-AttachVolumeTestJSON-1717945144-project Sep 04 16:26:28.194669 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: > Sep 04 16:26:28.194669 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Instance b4ab95ba-6b1d-482f-9160-c25b0c3ba82b could not be found. Sep 04 16:26:28.194669 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'id': 'b4ab95ba-6b1d-482f-9160-c25b0c3ba82b'} Sep 04 16:26:28.196414 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:26:28.196414 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:26:28.196414 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:26:28.196414 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:26:28.196414 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:26:28.196414 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:26:28.196414 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:26:28.196414 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:26:28.196414 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:26:28.196414 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:26:28.196414 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4ab95ba-6b1d-482f-9160-c25b0c3ba82b could not be found. Sep 04 16:26:28.196414 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:26:28.196414 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:26:28.196414 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:26:28.196414 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:26:28.196414 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:26:28.196414 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:26:28.196414 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:26:28.196414 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:26:28.196414 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:26:28.198099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:26:28.198099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 04 16:26:28.198099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 04 16:26:28.198099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 04 16:26:28.198099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 04 16:26:28.198099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:26:28.198099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:26:28.198099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:26:28.198099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:26:28.198099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4ab95ba-6b1d-482f-9160-c25b0c3ba82b could not be found. Sep 04 16:26:28.198099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:26:28.198099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:26:28.198099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:26:28.198099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:26:28.198099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:26:28.198099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:26:28.198099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:26:28.198099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:26:28.198099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4ab95ba-6b1d-482f-9160-c25b0c3ba82b could not be found. Sep 04 16:26:28.198099 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:26:28.199663 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-8b62bfe9-b0b8-42de-ade8-cdd82f06078e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Returning 404 to user: Instance b4ab95ba-6b1d-482f-9160-c25b0c3ba82b could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:26:28.199663 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-8b62bfe9-b0b8-42de-ade8-cdd82f06078e tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 404 len: 111 microversion: 2.1 time: 0.031010 Sep 04 16:26:28.199663 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 620/1234] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:26:28 2022] DELETE /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:26:28.202752 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c66aeb54-4f73-42dc-b183-2e19ac436e41 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:26:28.203388 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-c66aeb54-4f73-42dc-b183-2e19ac436e41 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] [instance: b4ab95ba-6b1d-482f-9160-c25b0c3ba82b] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:26:28.205863 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:26:28.210525 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c66aeb54-4f73-42dc-b183-2e19ac436e41 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:28.211048 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c66aeb54-4f73-42dc-b183-2e19ac436e41 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:28.211473 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c66aeb54-4f73-42dc-b183-2e19ac436e41 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:28.212148 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c66aeb54-4f73-42dc-b183-2e19ac436e41 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:26:28.212593 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c66aeb54-4f73-42dc-b183-2e19ac436e41 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:26:28.213006 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-c66aeb54-4f73-42dc-b183-2e19ac436e41 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:26:28.215766 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:26:28.227380 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-c66aeb54-4f73-42dc-b183-2e19ac436e41 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] HTTP exception thrown: Instance b4ab95ba-6b1d-482f-9160-c25b0c3ba82b could not be found. Sep 04 16:26:28.228885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c66aeb54-4f73-42dc-b183-2e19ac436e41 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Request method failure captured: Sep 04 16:26:28.228885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b HTTP/1.1 Sep 04 16:26:28.228885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:26:28.228885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:26:28.228885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:26:28.228885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:26:28.228885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:26:28.228885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:26:28.228885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:26:28.228885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:26:28.228885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFNCwPsNLOqN2R5acwUcgKonlmm3BbYspMprQDepoYiAKqsgcY0hWq1GQH0V6RDSl1H50EN9w3S3YJ1owauf9S8NF20RJCbKN3aPByDtXZET8XrEHAvUTpj8oqI4-3yM6ObAYjlMZRjVmUNVqlYPNPizaD1JNxJUqixh2SfB9WVMaRZY Sep 04 16:26:28.228885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:26:28.228885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:26:28.228885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:26:28.228885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:26:28.228885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:26:28.228885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:26:28.228885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: 6dde43a19e95472d87ea4273922156be Sep 04 16:26:28.228885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-AttachVolumeTestJSON-1717945144 Sep 04 16:26:28.228885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:26:28.228885 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:26:28.230605 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6dde43a19e95472d87ea4273922156be"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6dde43a19e95472d87ea4273922156be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6dde43a19e95472d87ea4273922156be", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6dde43a19e95472d87ea4273922156be"}]}] Sep 04 16:26:28.230605 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-AttachVolumeTestJSON-1717945144 Sep 04 16:26:28.230605 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 6dde43a19e95472d87ea4273922156be Sep 04 16:26:28.230605 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1717945144 Sep 04 16:26:28.230605 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-AttachVolumeTestJSON-1717945144-project Sep 04 16:26:28.230605 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:26:28.230605 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:26:28.230605 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: b1fa7bf738264e77b868ce9d7863214e Sep 04 16:26:28.230605 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-AttachVolumeTestJSON-1717945144-project Sep 04 16:26:28.230605 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: > Sep 04 16:26:28.230605 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Instance b4ab95ba-6b1d-482f-9160-c25b0c3ba82b could not be found. Sep 04 16:26:28.230605 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': 'b4ab95ba-6b1d-482f-9160-c25b0c3ba82b'} Sep 04 16:26:28.231577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:26:28.231577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:26:28.231577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:26:28.231577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:26:28.231577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:26:28.231577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:26:28.231577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:26:28.231577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:26:28.231577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:26:28.231577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:26:28.231577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4ab95ba-6b1d-482f-9160-c25b0c3ba82b could not be found. Sep 04 16:26:28.231577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:26:28.231577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:26:28.231577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:26:28.231577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:26:28.231577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:26:28.231577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:26:28.231577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:26:28.231577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:26:28.231577 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:26:28.233139 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:26:28.233139 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:26:28.233139 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:26:28.233139 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:26:28.233139 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:26:28.233139 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:26:28.233139 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:26:28.233139 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4ab95ba-6b1d-482f-9160-c25b0c3ba82b could not be found. Sep 04 16:26:28.233139 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:26:28.233139 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:26:28.233139 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:26:28.233139 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:26:28.233139 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:26:28.233139 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:26:28.233139 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:26:28.233139 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:26:28.233139 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4ab95ba-6b1d-482f-9160-c25b0c3ba82b could not be found. Sep 04 16:26:28.233139 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:26:28.235257 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-c66aeb54-4f73-42dc-b183-2e19ac436e41 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] Returning 404 to user: Instance b4ab95ba-6b1d-482f-9160-c25b0c3ba82b could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:26:28.235257 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-c66aeb54-4f73-42dc-b183-2e19ac436e41 tempest-AttachVolumeTestJSON-1717945144 tempest-AttachVolumeTestJSON-1717945144-project] 10.222.0.39 "GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b" status: 404 len: 111 microversion: 2.1 time: 0.031382 Sep 04 16:26:28.235257 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 615/1235] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:26:28 2022] GET /compute/v2.1/servers/b4ab95ba-6b1d-482f-9160-c25b0c3ba82b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:27:38.598294 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:27:38.599050 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:27:38.603713 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-05f0de27-8c1e-4bb4-9eeb-9c440c42f328 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-850462226", "imageRef": "11a460f6-29b0-46e6-ae98-e53ee2e13520", "flavorRef": "452", "networks": [{"uuid": "609e8e87-8bf1-43f8-82a4-b3963cc7e533"}]}} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:27:38.657665 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.network.neutron [None req-05f0de27-8c1e-4bb4-9eeb-9c440c42f328 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] validate_networks() for [('609e8e87-8bf1-43f8-82a4-b3963cc7e533', None, None, None, None, None)] {{(pid=121040) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 16:27:39.048618 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-05f0de27-8c1e-4bb4-9eeb-9c440c42f328 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Flavor limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 16:27:39.049044 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-05f0de27-8c1e-4bb4-9eeb-9c440c42f328 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Image limits 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 16:27:39.049517 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-05f0de27-8c1e-4bb4-9eeb-9c440c42f328 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Flavor pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 16:27:39.049953 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-05f0de27-8c1e-4bb4-9eeb-9c440c42f328 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Image pref 0:0:0 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 16:27:39.050366 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.virt.hardware [None req-05f0de27-8c1e-4bb4-9eeb-9c440c42f328 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121040) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 16:27:39.059184 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05f0de27-8c1e-4bb4-9eeb-9c440c42f328 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:39.059661 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05f0de27-8c1e-4bb4-9eeb-9c440c42f328 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:39.060094 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05f0de27-8c1e-4bb4-9eeb-9c440c42f328 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:39.060817 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05f0de27-8c1e-4bb4-9eeb-9c440c42f328 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:39.061937 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05f0de27-8c1e-4bb4-9eeb-9c440c42f328 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:39.062360 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-05f0de27-8c1e-4bb4-9eeb-9c440c42f328 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:39.079817 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-05f0de27-8c1e-4bb4-9eeb-9c440c42f328 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Getting quotas for project 68aaa192d3e244f6984f14a8eb59f050. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:27:39.083889 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.quota [None req-05f0de27-8c1e-4bb4-9eeb-9c440c42f328 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Getting quotas for user bb853b035f424dea91cc745a6322b377 and project 68aaa192d3e244f6984f14a8eb59f050. Resources: {'cores', 'ram', 'instances'} {{(pid=121040) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:27:39.095379 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-05f0de27-8c1e-4bb4-9eeb-9c440c42f328 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Going to run 1 instances... {{(pid=121040) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 16:27:39.097587 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-05f0de27-8c1e-4bb4-9eeb-9c440c42f328 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: c224b56a-2ad6-4c5d-8dc6-06d22a59e336] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a460f6-29b0-46e6-ae98-e53ee2e13520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121040) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 16:27:39.235513 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-05f0de27-8c1e-4bb4-9eeb-9c440c42f328 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.639074 Sep 04 16:27:39.236157 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 621/1236] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Sep 4 16:27:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 16:27:39.250887 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-1e9d5446-2007-412b-955d-6193668a229f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:27:39.255333 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-1e9d5446-2007-412b-955d-6193668a229f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: c224b56a-2ad6-4c5d-8dc6-06d22a59e336] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:27:39.308169 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-1e9d5446-2007-412b-955d-6193668a229f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:27:39.315774 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-1e9d5446-2007-412b-955d-6193668a229f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336" status: 200 len: 1213 microversion: 2.1 time: 0.072495 Sep 04 16:27:39.316364 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 616/1237] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:27:39 2022] GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336 => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:27:40.338584 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-1cd8452e-a090-4fb4-a56e-bf23bb1bb3f6 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:27:40.343353 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-1cd8452e-a090-4fb4-a56e-bf23bb1bb3f6 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: c224b56a-2ad6-4c5d-8dc6-06d22a59e336] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:27:40.396870 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-1cd8452e-a090-4fb4-a56e-bf23bb1bb3f6 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:27:40.404677 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-1cd8452e-a090-4fb4-a56e-bf23bb1bb3f6 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336" status: 200 len: 1213 microversion: 2.1 time: 0.070002 Sep 04 16:27:40.406854 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 622/1238] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:27:40 2022] GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336 => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:27:41.428500 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-bccb1736-ec8f-432b-9e4a-c9ab3277f775 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:27:41.429252 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-bccb1736-ec8f-432b-9e4a-c9ab3277f775 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: c224b56a-2ad6-4c5d-8dc6-06d22a59e336] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:27:41.437355 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bccb1736-ec8f-432b-9e4a-c9ab3277f775 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:41.437955 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bccb1736-ec8f-432b-9e4a-c9ab3277f775 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:41.438400 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bccb1736-ec8f-432b-9e4a-c9ab3277f775 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:41.439094 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bccb1736-ec8f-432b-9e4a-c9ab3277f775 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:41.439561 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bccb1736-ec8f-432b-9e4a-c9ab3277f775 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:41.439983 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-bccb1736-ec8f-432b-9e4a-c9ab3277f775 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:41.513357 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-bccb1736-ec8f-432b-9e4a-c9ab3277f775 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:27:41.521655 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-bccb1736-ec8f-432b-9e4a-c9ab3277f775 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336" status: 200 len: 1273 microversion: 2.1 time: 0.097294 Sep 04 16:27:41.522336 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 617/1239] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:27:41 2022] GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336 => generated 1273 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:27:42.545934 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-24e3ee2d-784f-4860-8919-fd7e4fc59637 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:27:42.546665 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-24e3ee2d-784f-4860-8919-fd7e4fc59637 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: c224b56a-2ad6-4c5d-8dc6-06d22a59e336] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:27:42.553682 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24e3ee2d-784f-4860-8919-fd7e4fc59637 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:42.554228 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24e3ee2d-784f-4860-8919-fd7e4fc59637 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:42.554721 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24e3ee2d-784f-4860-8919-fd7e4fc59637 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:42.555471 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24e3ee2d-784f-4860-8919-fd7e4fc59637 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:42.555982 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24e3ee2d-784f-4860-8919-fd7e4fc59637 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:42.556464 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-24e3ee2d-784f-4860-8919-fd7e4fc59637 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:42.754618 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-24e3ee2d-784f-4860-8919-fd7e4fc59637 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:27:42.762218 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-24e3ee2d-784f-4860-8919-fd7e4fc59637 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336" status: 200 len: 1313 microversion: 2.1 time: 0.220689 Sep 04 16:27:42.762779 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 623/1240] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:27:42 2022] GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:27:43.114670 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-a460d8d8-7abb-4280-ab39-1b5967e2a197 req-bda6ceaa-cdf8-48b4-93c7-d0415c028b6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c224b56a-2ad6-4c5d-8dc6-06d22a59e336", "tag": "e3d0163c-c823-40b7-a8e7-91116d3e8b41"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:27:43.125071 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-a460d8d8-7abb-4280-ab39-1b5967e2a197 req-bda6ceaa-cdf8-48b4-93c7-d0415c028b6d service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:43.125537 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-a460d8d8-7abb-4280-ab39-1b5967e2a197 req-bda6ceaa-cdf8-48b4-93c7-d0415c028b6d service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:43.125993 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-a460d8d8-7abb-4280-ab39-1b5967e2a197 req-bda6ceaa-cdf8-48b4-93c7-d0415c028b6d service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:43.138469 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-a460d8d8-7abb-4280-ab39-1b5967e2a197 req-bda6ceaa-cdf8-48b4-93c7-d0415c028b6d service nova] Creating event network-changed:e3d0163c-c823-40b7-a8e7-91116d3e8b41 for instance c224b56a-2ad6-4c5d-8dc6-06d22a59e336 on hv-cinder-85236 Sep 04 16:27:43.144477 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-a460d8d8-7abb-4280-ab39-1b5967e2a197 req-bda6ceaa-cdf8-48b4-93c7-d0415c028b6d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033491 Sep 04 16:27:43.147491 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 618/1241] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:27:43.787872 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-282f8125-f6dd-422b-afa3-6aeb82778db4 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:27:43.788443 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-282f8125-f6dd-422b-afa3-6aeb82778db4 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: c224b56a-2ad6-4c5d-8dc6-06d22a59e336] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:27:43.794738 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-282f8125-f6dd-422b-afa3-6aeb82778db4 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:43.795225 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-282f8125-f6dd-422b-afa3-6aeb82778db4 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:43.797022 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-282f8125-f6dd-422b-afa3-6aeb82778db4 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:43.797763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-282f8125-f6dd-422b-afa3-6aeb82778db4 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:43.798219 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-282f8125-f6dd-422b-afa3-6aeb82778db4 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:43.798640 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-282f8125-f6dd-422b-afa3-6aeb82778db4 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:43.929668 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-282f8125-f6dd-422b-afa3-6aeb82778db4 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:27:43.938039 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-282f8125-f6dd-422b-afa3-6aeb82778db4 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336" status: 200 len: 1313 microversion: 2.1 time: 0.154185 Sep 04 16:27:43.938965 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 624/1242] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:27:43 2022] GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:27:44.965456 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-63820d9f-41b7-4af8-bb36-255bc341d7cb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:27:44.966093 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-63820d9f-41b7-4af8-bb36-255bc341d7cb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: c224b56a-2ad6-4c5d-8dc6-06d22a59e336] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:27:44.972238 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-63820d9f-41b7-4af8-bb36-255bc341d7cb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:44.972718 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-63820d9f-41b7-4af8-bb36-255bc341d7cb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:44.973149 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-63820d9f-41b7-4af8-bb36-255bc341d7cb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:44.973865 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-63820d9f-41b7-4af8-bb36-255bc341d7cb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:44.974312 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-63820d9f-41b7-4af8-bb36-255bc341d7cb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:44.974732 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-63820d9f-41b7-4af8-bb36-255bc341d7cb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:45.101889 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-63820d9f-41b7-4af8-bb36-255bc341d7cb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:27:45.110007 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-63820d9f-41b7-4af8-bb36-255bc341d7cb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336" status: 200 len: 1313 microversion: 2.1 time: 0.149467 Sep 04 16:27:45.110571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 619/1243] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:27:44 2022] GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:27:46.132646 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-85e4caf3-61b3-4af1-9d16-45b01e642207 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:27:46.133234 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-85e4caf3-61b3-4af1-9d16-45b01e642207 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: c224b56a-2ad6-4c5d-8dc6-06d22a59e336] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:27:46.140223 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85e4caf3-61b3-4af1-9d16-45b01e642207 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:46.140691 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85e4caf3-61b3-4af1-9d16-45b01e642207 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:46.141117 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85e4caf3-61b3-4af1-9d16-45b01e642207 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:46.141818 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85e4caf3-61b3-4af1-9d16-45b01e642207 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:46.142278 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85e4caf3-61b3-4af1-9d16-45b01e642207 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:46.142673 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-85e4caf3-61b3-4af1-9d16-45b01e642207 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:46.274332 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-85e4caf3-61b3-4af1-9d16-45b01e642207 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:27:46.282015 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-85e4caf3-61b3-4af1-9d16-45b01e642207 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336" status: 200 len: 1313 microversion: 2.1 time: 0.153216 Sep 04 16:27:46.282572 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 625/1244] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:27:46 2022] GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:27:47.305942 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-08890f6b-d09e-4a59-a94e-fed2c6e1b156 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:27:47.306550 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-08890f6b-d09e-4a59-a94e-fed2c6e1b156 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: c224b56a-2ad6-4c5d-8dc6-06d22a59e336] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:27:47.313278 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08890f6b-d09e-4a59-a94e-fed2c6e1b156 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:47.313808 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08890f6b-d09e-4a59-a94e-fed2c6e1b156 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:47.314250 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08890f6b-d09e-4a59-a94e-fed2c6e1b156 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:47.314947 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08890f6b-d09e-4a59-a94e-fed2c6e1b156 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:47.315405 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08890f6b-d09e-4a59-a94e-fed2c6e1b156 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:47.315831 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-08890f6b-d09e-4a59-a94e-fed2c6e1b156 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:47.442072 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-08890f6b-d09e-4a59-a94e-fed2c6e1b156 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:27:47.449606 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-08890f6b-d09e-4a59-a94e-fed2c6e1b156 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336" status: 200 len: 1313 microversion: 2.1 time: 0.147639 Sep 04 16:27:47.450173 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 620/1245] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:27:47 2022] GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 04 16:27:48.473256 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-da5018c6-ca92-424c-a2a1-c0ea8a3e952d tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:27:48.473883 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-da5018c6-ca92-424c-a2a1-c0ea8a3e952d tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: c224b56a-2ad6-4c5d-8dc6-06d22a59e336] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:27:48.480399 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da5018c6-ca92-424c-a2a1-c0ea8a3e952d tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:48.480869 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da5018c6-ca92-424c-a2a1-c0ea8a3e952d tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:48.481296 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da5018c6-ca92-424c-a2a1-c0ea8a3e952d tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:48.482005 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da5018c6-ca92-424c-a2a1-c0ea8a3e952d tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:48.482451 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da5018c6-ca92-424c-a2a1-c0ea8a3e952d tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:48.483463 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-da5018c6-ca92-424c-a2a1-c0ea8a3e952d tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:48.611735 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-da5018c6-ca92-424c-a2a1-c0ea8a3e952d tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:27:48.619409 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-da5018c6-ca92-424c-a2a1-c0ea8a3e952d tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336" status: 200 len: 1313 microversion: 2.1 time: 0.150188 Sep 04 16:27:48.619976 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 626/1246] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:27:48 2022] GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:27:49.643448 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-66bb2bcd-b854-4591-8d2e-377a54b3e017 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:27:49.644011 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-66bb2bcd-b854-4591-8d2e-377a54b3e017 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: c224b56a-2ad6-4c5d-8dc6-06d22a59e336] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:27:49.646266 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:27:49.651234 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66bb2bcd-b854-4591-8d2e-377a54b3e017 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:49.651733 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66bb2bcd-b854-4591-8d2e-377a54b3e017 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:49.652177 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66bb2bcd-b854-4591-8d2e-377a54b3e017 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:49.652889 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66bb2bcd-b854-4591-8d2e-377a54b3e017 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:49.653347 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66bb2bcd-b854-4591-8d2e-377a54b3e017 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:49.653803 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-66bb2bcd-b854-4591-8d2e-377a54b3e017 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:49.791302 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-66bb2bcd-b854-4591-8d2e-377a54b3e017 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:27:49.799693 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-66bb2bcd-b854-4591-8d2e-377a54b3e017 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336" status: 200 len: 1313 microversion: 2.1 time: 0.160930 Sep 04 16:27:49.800283 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 621/1247] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:27:49 2022] GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:27:49.818666 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-f1384008-c566-4923-8c8c-459551340957 req-eb132da7-4a56-4183-91aa-de66f9dbb30d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c224b56a-2ad6-4c5d-8dc6-06d22a59e336", "name": "network-vif-plugged", "status": "completed", "tag": "e3d0163c-c823-40b7-a8e7-91116d3e8b41"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:27:49.823632 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:27:49.830223 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f1384008-c566-4923-8c8c-459551340957 req-eb132da7-4a56-4183-91aa-de66f9dbb30d service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:49.830696 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f1384008-c566-4923-8c8c-459551340957 req-eb132da7-4a56-4183-91aa-de66f9dbb30d service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:49.831127 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-f1384008-c566-4923-8c8c-459551340957 req-eb132da7-4a56-4183-91aa-de66f9dbb30d service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:49.841745 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-f1384008-c566-4923-8c8c-459551340957 req-eb132da7-4a56-4183-91aa-de66f9dbb30d service nova] Creating event network-vif-plugged:e3d0163c-c823-40b7-a8e7-91116d3e8b41 for instance c224b56a-2ad6-4c5d-8dc6-06d22a59e336 on hv-cinder-85236 Sep 04 16:27:49.847014 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-f1384008-c566-4923-8c8c-459551340957 req-eb132da7-4a56-4183-91aa-de66f9dbb30d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032314 Sep 04 16:27:49.847672 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 627/1248] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:27:50.823905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-395c3f87-8be1-4d6e-a1a7-48b44cfa3b0c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:27:50.824451 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-395c3f87-8be1-4d6e-a1a7-48b44cfa3b0c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: c224b56a-2ad6-4c5d-8dc6-06d22a59e336] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:27:50.830931 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-395c3f87-8be1-4d6e-a1a7-48b44cfa3b0c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:50.831416 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-395c3f87-8be1-4d6e-a1a7-48b44cfa3b0c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:50.831855 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-395c3f87-8be1-4d6e-a1a7-48b44cfa3b0c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:50.832554 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-395c3f87-8be1-4d6e-a1a7-48b44cfa3b0c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:50.833010 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-395c3f87-8be1-4d6e-a1a7-48b44cfa3b0c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:50.833437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-395c3f87-8be1-4d6e-a1a7-48b44cfa3b0c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:50.960684 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-395c3f87-8be1-4d6e-a1a7-48b44cfa3b0c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:27:50.968437 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-395c3f87-8be1-4d6e-a1a7-48b44cfa3b0c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336" status: 200 len: 1313 microversion: 2.1 time: 0.148572 Sep 04 16:27:50.969011 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 622/1249] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:27:50 2022] GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:27:51.993359 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=8 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:27:51.998293 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-41af1196-8a19-496b-9ab8-77d27cd77bba tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:27:51.999640 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-41af1196-8a19-496b-9ab8-77d27cd77bba tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: c224b56a-2ad6-4c5d-8dc6-06d22a59e336] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:27:52.005718 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41af1196-8a19-496b-9ab8-77d27cd77bba tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:52.007616 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41af1196-8a19-496b-9ab8-77d27cd77bba tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:52.007616 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41af1196-8a19-496b-9ab8-77d27cd77bba tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:52.007616 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41af1196-8a19-496b-9ab8-77d27cd77bba tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:52.008208 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41af1196-8a19-496b-9ab8-77d27cd77bba tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:52.008208 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-41af1196-8a19-496b-9ab8-77d27cd77bba tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:52.137480 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-41af1196-8a19-496b-9ab8-77d27cd77bba tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:27:52.145709 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-41af1196-8a19-496b-9ab8-77d27cd77bba tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336" status: 200 len: 1497 microversion: 2.1 time: 0.153248 Sep 04 16:27:52.146274 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 628/1250] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:27:51 2022] GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336 => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:27:52.942827 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-4c76fe08-d1a5-4415-8be6-e2b1d4f6bc52 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:27:52.943401 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4c76fe08-d1a5-4415-8be6-e2b1d4f6bc52 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: c224b56a-2ad6-4c5d-8dc6-06d22a59e336] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:27:52.949729 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c76fe08-d1a5-4415-8be6-e2b1d4f6bc52 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:52.950217 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c76fe08-d1a5-4415-8be6-e2b1d4f6bc52 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:52.950657 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c76fe08-d1a5-4415-8be6-e2b1d4f6bc52 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:52.951351 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c76fe08-d1a5-4415-8be6-e2b1d4f6bc52 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:52.952365 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c76fe08-d1a5-4415-8be6-e2b1d4f6bc52 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:52.952856 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-4c76fe08-d1a5-4415-8be6-e2b1d4f6bc52 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:52.978443 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-4c76fe08-d1a5-4415-8be6-e2b1d4f6bc52 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: c224b56a-2ad6-4c5d-8dc6-06d22a59e336] Going to try to terminate instance {{(pid=121041) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 16:27:53.251629 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-4c76fe08-d1a5-4415-8be6-e2b1d4f6bc52 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336" status: 204 len: 0 microversion: 2.1 time: 0.312274 Sep 04 16:27:53.252153 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 623/1251] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:27:52 2022] DELETE /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 16:27:53.260405 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ce7bb38f-bd14-41ee-93c0-f52c645ee92c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:27:53.261072 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ce7bb38f-bd14-41ee-93c0-f52c645ee92c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: c224b56a-2ad6-4c5d-8dc6-06d22a59e336] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:27:53.268109 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce7bb38f-bd14-41ee-93c0-f52c645ee92c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:53.268578 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce7bb38f-bd14-41ee-93c0-f52c645ee92c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:53.269002 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce7bb38f-bd14-41ee-93c0-f52c645ee92c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:53.269701 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce7bb38f-bd14-41ee-93c0-f52c645ee92c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:53.270146 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce7bb38f-bd14-41ee-93c0-f52c645ee92c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:53.270560 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ce7bb38f-bd14-41ee-93c0-f52c645ee92c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:53.401728 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ce7bb38f-bd14-41ee-93c0-f52c645ee92c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:27:53.410097 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ce7bb38f-bd14-41ee-93c0-f52c645ee92c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336" status: 200 len: 1503 microversion: 2.1 time: 0.153606 Sep 04 16:27:53.410671 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 629/1252] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:27:53 2022] GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:27:54.433965 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-948cc035-13c9-4c30-85ca-70211766c1f8 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:27:54.434666 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-948cc035-13c9-4c30-85ca-70211766c1f8 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: c224b56a-2ad6-4c5d-8dc6-06d22a59e336] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:27:54.441154 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-948cc035-13c9-4c30-85ca-70211766c1f8 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:54.441648 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-948cc035-13c9-4c30-85ca-70211766c1f8 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:54.442089 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-948cc035-13c9-4c30-85ca-70211766c1f8 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:54.442785 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-948cc035-13c9-4c30-85ca-70211766c1f8 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:54.443235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-948cc035-13c9-4c30-85ca-70211766c1f8 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:54.443654 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-948cc035-13c9-4c30-85ca-70211766c1f8 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:54.607571 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-948cc035-13c9-4c30-85ca-70211766c1f8 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:27:54.615427 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-948cc035-13c9-4c30-85ca-70211766c1f8 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336" status: 200 len: 1503 microversion: 2.1 time: 0.185827 Sep 04 16:27:54.616014 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 624/1253] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:27:54 2022] GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336 => generated 1503 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:27:55.101104 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-452e2ac8-80a2-4dd8-9a6a-726005224f45 req-d61406ed-e4c9-4aa1-af4b-2087d9313d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c224b56a-2ad6-4c5d-8dc6-06d22a59e336", "name": "network-vif-deleted", "tag": "e3d0163c-c823-40b7-a8e7-91116d3e8b41"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:27:55.111710 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-452e2ac8-80a2-4dd8-9a6a-726005224f45 req-d61406ed-e4c9-4aa1-af4b-2087d9313d31 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:55.112186 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-452e2ac8-80a2-4dd8-9a6a-726005224f45 req-d61406ed-e4c9-4aa1-af4b-2087d9313d31 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:55.112611 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-452e2ac8-80a2-4dd8-9a6a-726005224f45 req-d61406ed-e4c9-4aa1-af4b-2087d9313d31 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:55.124125 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-452e2ac8-80a2-4dd8-9a6a-726005224f45 req-d61406ed-e4c9-4aa1-af4b-2087d9313d31 service nova] Creating event network-vif-deleted:e3d0163c-c823-40b7-a8e7-91116d3e8b41 for instance c224b56a-2ad6-4c5d-8dc6-06d22a59e336 on hv-cinder-85236 Sep 04 16:27:55.129189 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-452e2ac8-80a2-4dd8-9a6a-726005224f45 req-d61406ed-e4c9-4aa1-af4b-2087d9313d31 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031786 Sep 04 16:27:55.129808 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 630/1254] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:27:55.638599 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-2915ab2c-116a-41df-b8cd-d9682de03377 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:27:55.639180 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-2915ab2c-116a-41df-b8cd-d9682de03377 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: c224b56a-2ad6-4c5d-8dc6-06d22a59e336] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:27:55.645961 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2915ab2c-116a-41df-b8cd-d9682de03377 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:55.646440 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2915ab2c-116a-41df-b8cd-d9682de03377 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:55.646874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2915ab2c-116a-41df-b8cd-d9682de03377 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:55.647560 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2915ab2c-116a-41df-b8cd-d9682de03377 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:55.648011 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2915ab2c-116a-41df-b8cd-d9682de03377 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:55.648435 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2915ab2c-116a-41df-b8cd-d9682de03377 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:55.682890 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2915ab2c-116a-41df-b8cd-d9682de03377 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:55.683372 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2915ab2c-116a-41df-b8cd-d9682de03377 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:55.683803 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-2915ab2c-116a-41df-b8cd-d9682de03377 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:55.684258 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.objects.instance [None req-2915ab2c-116a-41df-b8cd-d9682de03377 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lazy-loading 'fault' on Instance uuid c224b56a-2ad6-4c5d-8dc6-06d22a59e336 {{(pid=121041) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:27:55.728742 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-2915ab2c-116a-41df-b8cd-d9682de03377 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:27:55.737273 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-2915ab2c-116a-41df-b8cd-d9682de03377 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336" status: 200 len: 1303 microversion: 2.1 time: 0.102643 Sep 04 16:27:55.737874 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 625/1255] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:27:55 2022] GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:27:56.763994 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-31bd19ef-1af6-4af2-9470-a3f8f32ce020 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:27:56.764805 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-31bd19ef-1af6-4af2-9470-a3f8f32ce020 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: c224b56a-2ad6-4c5d-8dc6-06d22a59e336] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:27:56.770886 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31bd19ef-1af6-4af2-9470-a3f8f32ce020 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:56.771354 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31bd19ef-1af6-4af2-9470-a3f8f32ce020 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:56.771782 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31bd19ef-1af6-4af2-9470-a3f8f32ce020 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:56.772459 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31bd19ef-1af6-4af2-9470-a3f8f32ce020 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:56.772902 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31bd19ef-1af6-4af2-9470-a3f8f32ce020 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:56.773314 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-31bd19ef-1af6-4af2-9470-a3f8f32ce020 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:56.786539 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.wsgi [None req-31bd19ef-1af6-4af2-9470-a3f8f32ce020 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] HTTP exception thrown: Instance c224b56a-2ad6-4c5d-8dc6-06d22a59e336 could not be found. Sep 04 16:27:56.788381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-31bd19ef-1af6-4af2-9470-a3f8f32ce020 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Request method failure captured: Sep 04 16:27:56.788381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: request: GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336 HTTP/1.1 Sep 04 16:27:56.788381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept: application/json Sep 04 16:27:56.788381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Accept-Encoding: identity Sep 04 16:27:56.788381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Connection: close Sep 04 16:27:56.788381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Length: 0 Sep 04 16:27:56.788381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Content-Type: application/json Sep 04 16:27:56.788381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Host: 10.222.0.39 Sep 04 16:27:56.788381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: Openstack-System-Scope: None Sep 04 16:27:56.788381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: User-Agent: python-urllib3/1.26.12 Sep 04 16:27:56.788381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Auth-Token: gAAAAABjFNH4jeeg2Tq8HnIOM_gTcUD-uopzSY26UHocsS0e1uzl-qXjyAi-1eyz6yKg-w8yr6BO9YF5wAnYwp90zHAeyezIlQVaA3JU9tj6hixTZtkLecF8SVyQlt9oXojAZxqSjzh6MuApFKVjOpKqxl2RRyj9q6Em6V9JK37nEHyzud1aUA8 Sep 04 16:27:56.788381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Id: None Sep 04 16:27:56.788381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Domain-Name: None Sep 04 16:27:56.788381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Identity-Status: Confirmed Sep 04 16:27:56.788381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Is-Admin-Project: True Sep 04 16:27:56.788381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Id: default Sep 04 16:27:56.788381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Domain-Name: Default Sep 04 16:27:56.788381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Id: 68aaa192d3e244f6984f14a8eb59f050 Sep 04 16:27:56.788381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Project-Name: tempest-VolumesActionsTest-336135920 Sep 04 16:27:56.788381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Role: reader,member Sep 04 16:27:56.788381 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Roles: reader,member Sep 04 16:27:56.790169 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/68aaa192d3e244f6984f14a8eb59f050"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/68aaa192d3e244f6984f14a8eb59f050"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_68aaa192d3e244f6984f14a8eb59f050", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/68aaa192d3e244f6984f14a8eb59f050"}]}] Sep 04 16:27:56.790169 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant: tempest-VolumesActionsTest-336135920 Sep 04 16:27:56.790169 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Id: 68aaa192d3e244f6984f14a8eb59f050 Sep 04 16:27:56.790169 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-Tenant-Name: tempest-VolumesActionsTest-336135920 Sep 04 16:27:56.790169 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User: tempest-VolumesActionsTest-336135920-project Sep 04 16:27:56.790169 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Id: default Sep 04 16:27:56.790169 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Domain-Name: Default Sep 04 16:27:56.790169 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Id: bb853b035f424dea91cc745a6322b377 Sep 04 16:27:56.790169 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: X-User-Name: tempest-VolumesActionsTest-336135920-project Sep 04 16:27:56.790169 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: method: > Sep 04 16:27:56.790169 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: exception: Instance c224b56a-2ad6-4c5d-8dc6-06d22a59e336 could not be found. Sep 04 16:27:56.790169 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: action_args: {'id': 'c224b56a-2ad6-4c5d-8dc6-06d22a59e336'} Sep 04 16:27:56.791407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:27:56.791407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:27:56.791407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:27:56.791407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:27:56.791407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:27:56.791407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:27:56.791407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:27:56.791407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:27:56.791407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:27:56.791407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:27:56.791407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c224b56a-2ad6-4c5d-8dc6-06d22a59e336 could not be found. Sep 04 16:27:56.791407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:27:56.791407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:27:56.791407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:27:56.791407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:27:56.791407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:27:56.791407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:27:56.791407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:27:56.791407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:27:56.791407 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:27:56.793086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:27:56.793086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:27:56.793086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:27:56.793086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:27:56.793086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:27:56.793086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:27:56.793086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:27:56.793086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c224b56a-2ad6-4c5d-8dc6-06d22a59e336 could not be found. Sep 04 16:27:56.793086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:27:56.793086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:27:56.793086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:27:56.793086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:27:56.793086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:27:56.793086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:27:56.793086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:27:56.793086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:27:56.793086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c224b56a-2ad6-4c5d-8dc6-06d22a59e336 could not be found. Sep 04 16:27:56.793086 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: ERROR nova.api.openstack.wsgi Sep 04 16:27:56.794584 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-31bd19ef-1af6-4af2-9470-a3f8f32ce020 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Returning 404 to user: Instance c224b56a-2ad6-4c5d-8dc6-06d22a59e336 could not be found. {{(pid=121040) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:27:56.794584 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-31bd19ef-1af6-4af2-9470-a3f8f32ce020 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336" status: 404 len: 111 microversion: 2.1 time: 0.030578 Sep 04 16:27:56.794584 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 631/1256] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:27:56 2022] GET /compute/v2.1/servers/c224b56a-2ad6-4c5d-8dc6-06d22a59e336 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 04 16:27:56.839223 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-cd5149d3-19a3-478e-8304-ec5c8240a0ea tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1476253965", "imageRef": "11a460f6-29b0-46e6-ae98-e53ee2e13520", "flavorRef": "452", "networks": [{"uuid": "609e8e87-8bf1-43f8-82a4-b3963cc7e533"}]}} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:27:56.891967 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.network.neutron [None req-cd5149d3-19a3-478e-8304-ec5c8240a0ea tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] validate_networks() for [('609e8e87-8bf1-43f8-82a4-b3963cc7e533', None, None, None, None, None)] {{(pid=121041) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 04 16:27:57.296376 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-cd5149d3-19a3-478e-8304-ec5c8240a0ea tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Flavor limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 04 16:27:57.296800 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-cd5149d3-19a3-478e-8304-ec5c8240a0ea tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Image limits 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 04 16:27:57.297311 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-cd5149d3-19a3-478e-8304-ec5c8240a0ea tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Flavor pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 04 16:27:57.297771 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-cd5149d3-19a3-478e-8304-ec5c8240a0ea tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Image pref 0:0:0 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 04 16:27:57.298187 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.virt.hardware [None req-cd5149d3-19a3-478e-8304-ec5c8240a0ea tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121041) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 04 16:27:57.307270 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd5149d3-19a3-478e-8304-ec5c8240a0ea tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:57.307702 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd5149d3-19a3-478e-8304-ec5c8240a0ea tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:57.308130 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd5149d3-19a3-478e-8304-ec5c8240a0ea tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:57.308848 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd5149d3-19a3-478e-8304-ec5c8240a0ea tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:57.309320 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd5149d3-19a3-478e-8304-ec5c8240a0ea tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:57.309786 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-cd5149d3-19a3-478e-8304-ec5c8240a0ea tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:57.327816 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-cd5149d3-19a3-478e-8304-ec5c8240a0ea tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Getting quotas for project 68aaa192d3e244f6984f14a8eb59f050. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 04 16:27:57.331845 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.quota [None req-cd5149d3-19a3-478e-8304-ec5c8240a0ea tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Getting quotas for user bb853b035f424dea91cc745a6322b377 and project 68aaa192d3e244f6984f14a8eb59f050. Resources: {'cores', 'ram', 'instances'} {{(pid=121041) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 04 16:27:57.342908 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cd5149d3-19a3-478e-8304-ec5c8240a0ea tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Going to run 1 instances... {{(pid=121041) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 04 16:27:57.345231 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-cd5149d3-19a3-478e-8304-ec5c8240a0ea tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: b7073718-c360-4e5b-a449-1b9248d5beb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='11a460f6-29b0-46e6-ae98-e53ee2e13520',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121041) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 04 16:27:57.444659 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-cd5149d3-19a3-478e-8304-ec5c8240a0ea tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609214 Sep 04 16:27:57.445305 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 626/1257] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Sep 4 16:27:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 04 16:27:57.456995 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-a6d9d3c1-6386-41b1-a7c6-eaf90c7a641b tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:27:57.457627 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-a6d9d3c1-6386-41b1-a7c6-eaf90c7a641b tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: b7073718-c360-4e5b-a449-1b9248d5beb0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:27:57.512829 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-a6d9d3c1-6386-41b1-a7c6-eaf90c7a641b tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:27:57.520192 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-a6d9d3c1-6386-41b1-a7c6-eaf90c7a641b tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0" status: 200 len: 1214 microversion: 2.1 time: 0.067088 Sep 04 16:27:57.520763 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 632/1258] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:27:57 2022] GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:27:58.543385 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-b11aaf59-f1c9-4b4c-8e33-0531d201ec36 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:27:58.543996 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-b11aaf59-f1c9-4b4c-8e33-0531d201ec36 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: b7073718-c360-4e5b-a449-1b9248d5beb0] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:27:58.550813 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b11aaf59-f1c9-4b4c-8e33-0531d201ec36 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:58.551293 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b11aaf59-f1c9-4b4c-8e33-0531d201ec36 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:58.551730 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b11aaf59-f1c9-4b4c-8e33-0531d201ec36 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:58.552425 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b11aaf59-f1c9-4b4c-8e33-0531d201ec36 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:58.552921 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b11aaf59-f1c9-4b4c-8e33-0531d201ec36 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:58.553346 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-b11aaf59-f1c9-4b4c-8e33-0531d201ec36 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:58.613930 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-b11aaf59-f1c9-4b4c-8e33-0531d201ec36 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:27:58.621657 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-b11aaf59-f1c9-4b4c-8e33-0531d201ec36 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0" status: 200 len: 1218 microversion: 2.1 time: 0.082819 Sep 04 16:27:58.622223 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 627/1259] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:27:58 2022] GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:27:59.645110 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-53eb9bde-efd8-40ad-9426-695d0aa37e59 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:27:59.646033 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-53eb9bde-efd8-40ad-9426-695d0aa37e59 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: b7073718-c360-4e5b-a449-1b9248d5beb0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:27:59.654454 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53eb9bde-efd8-40ad-9426-695d0aa37e59 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:59.655292 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53eb9bde-efd8-40ad-9426-695d0aa37e59 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:59.655447 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53eb9bde-efd8-40ad-9426-695d0aa37e59 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:59.656141 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53eb9bde-efd8-40ad-9426-695d0aa37e59 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:27:59.656591 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53eb9bde-efd8-40ad-9426-695d0aa37e59 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:27:59.657007 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-53eb9bde-efd8-40ad-9426-695d0aa37e59 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:27:59.734612 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-53eb9bde-efd8-40ad-9426-695d0aa37e59 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:27:59.745847 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-53eb9bde-efd8-40ad-9426-695d0aa37e59 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0" status: 200 len: 1284 microversion: 2.1 time: 0.104660 Sep 04 16:27:59.747308 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 633/1260] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:27:59 2022] GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0 => generated 1284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:28:00.768516 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-9508703f-c254-4d4b-b53f-879677ff2e2f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:28:00.769233 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-9508703f-c254-4d4b-b53f-879677ff2e2f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: b7073718-c360-4e5b-a449-1b9248d5beb0] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:28:00.776068 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9508703f-c254-4d4b-b53f-879677ff2e2f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:00.776628 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9508703f-c254-4d4b-b53f-879677ff2e2f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:00.777064 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9508703f-c254-4d4b-b53f-879677ff2e2f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:00.777970 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9508703f-c254-4d4b-b53f-879677ff2e2f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:00.778505 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9508703f-c254-4d4b-b53f-879677ff2e2f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:00.778931 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-9508703f-c254-4d4b-b53f-879677ff2e2f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:00.943724 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-9508703f-c254-4d4b-b53f-879677ff2e2f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:28:00.951239 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-9508703f-c254-4d4b-b53f-879677ff2e2f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0" status: 200 len: 1314 microversion: 2.1 time: 0.186791 Sep 04 16:28:00.952881 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 628/1261] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:28:00 2022] GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:28:01.316779 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-93bb01bb-0fed-44bb-b0c2-f7df3df23566 req-72d6a5ba-6fe1-403a-b662-b524f9b151fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7073718-c360-4e5b-a449-1b9248d5beb0", "tag": "a0ab2bbe-fa90-4418-b394-464952edf32c"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:28:01.329032 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-93bb01bb-0fed-44bb-b0c2-f7df3df23566 req-72d6a5ba-6fe1-403a-b662-b524f9b151fc service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:01.329503 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-93bb01bb-0fed-44bb-b0c2-f7df3df23566 req-72d6a5ba-6fe1-403a-b662-b524f9b151fc service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:01.330017 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-93bb01bb-0fed-44bb-b0c2-f7df3df23566 req-72d6a5ba-6fe1-403a-b662-b524f9b151fc service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:01.341401 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-93bb01bb-0fed-44bb-b0c2-f7df3df23566 req-72d6a5ba-6fe1-403a-b662-b524f9b151fc service nova] Creating event network-changed:a0ab2bbe-fa90-4418-b394-464952edf32c for instance b7073718-c360-4e5b-a449-1b9248d5beb0 on hv-cinder-85236 Sep 04 16:28:01.347092 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-93bb01bb-0fed-44bb-b0c2-f7df3df23566 req-72d6a5ba-6fe1-403a-b662-b524f9b151fc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037480 Sep 04 16:28:01.351385 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 634/1262] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 04 16:28:01.976066 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-98c3dccd-fe25-4260-85a6-b14e5eab494f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:28:01.976631 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-98c3dccd-fe25-4260-85a6-b14e5eab494f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: b7073718-c360-4e5b-a449-1b9248d5beb0] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:28:01.983837 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-98c3dccd-fe25-4260-85a6-b14e5eab494f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:01.984332 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-98c3dccd-fe25-4260-85a6-b14e5eab494f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:01.984769 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-98c3dccd-fe25-4260-85a6-b14e5eab494f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:01.985491 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-98c3dccd-fe25-4260-85a6-b14e5eab494f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:01.985982 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-98c3dccd-fe25-4260-85a6-b14e5eab494f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:01.986411 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-98c3dccd-fe25-4260-85a6-b14e5eab494f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:02.119614 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-98c3dccd-fe25-4260-85a6-b14e5eab494f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:28:02.128302 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-98c3dccd-fe25-4260-85a6-b14e5eab494f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0" status: 200 len: 1314 microversion: 2.1 time: 0.156307 Sep 04 16:28:02.128871 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 629/1263] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:28:01 2022] GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:28:03.151888 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-d99a728f-dec0-4e56-a86e-c0bb199c43c3 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:28:03.152613 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-d99a728f-dec0-4e56-a86e-c0bb199c43c3 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: b7073718-c360-4e5b-a449-1b9248d5beb0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:28:03.159214 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d99a728f-dec0-4e56-a86e-c0bb199c43c3 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:03.159694 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d99a728f-dec0-4e56-a86e-c0bb199c43c3 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:03.160128 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d99a728f-dec0-4e56-a86e-c0bb199c43c3 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:03.160811 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d99a728f-dec0-4e56-a86e-c0bb199c43c3 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:03.161264 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d99a728f-dec0-4e56-a86e-c0bb199c43c3 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:03.161722 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-d99a728f-dec0-4e56-a86e-c0bb199c43c3 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:03.287671 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-d99a728f-dec0-4e56-a86e-c0bb199c43c3 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:28:03.295193 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-d99a728f-dec0-4e56-a86e-c0bb199c43c3 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0" status: 200 len: 1314 microversion: 2.1 time: 0.148204 Sep 04 16:28:03.295761 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 635/1264] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:28:03 2022] GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:28:04.317622 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-a28d79e9-83b8-4d96-8814-5af70217d9a1 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:28:04.318233 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-a28d79e9-83b8-4d96-8814-5af70217d9a1 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: b7073718-c360-4e5b-a449-1b9248d5beb0] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:28:04.324639 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a28d79e9-83b8-4d96-8814-5af70217d9a1 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:04.325117 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a28d79e9-83b8-4d96-8814-5af70217d9a1 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:04.325543 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a28d79e9-83b8-4d96-8814-5af70217d9a1 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:04.326252 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a28d79e9-83b8-4d96-8814-5af70217d9a1 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:04.327380 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a28d79e9-83b8-4d96-8814-5af70217d9a1 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:04.327923 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-a28d79e9-83b8-4d96-8814-5af70217d9a1 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:04.459583 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-a28d79e9-83b8-4d96-8814-5af70217d9a1 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:28:04.467235 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-a28d79e9-83b8-4d96-8814-5af70217d9a1 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0" status: 200 len: 1314 microversion: 2.1 time: 0.153466 Sep 04 16:28:04.469944 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 630/1265] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:28:04 2022] GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:28:05.490175 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-69d1e341-1f7d-4af0-991d-407327423e45 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:28:05.490776 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-69d1e341-1f7d-4af0-991d-407327423e45 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: b7073718-c360-4e5b-a449-1b9248d5beb0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:28:05.497237 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69d1e341-1f7d-4af0-991d-407327423e45 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:05.497746 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69d1e341-1f7d-4af0-991d-407327423e45 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:05.498171 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69d1e341-1f7d-4af0-991d-407327423e45 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:05.498886 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69d1e341-1f7d-4af0-991d-407327423e45 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:05.499415 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69d1e341-1f7d-4af0-991d-407327423e45 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:05.499831 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69d1e341-1f7d-4af0-991d-407327423e45 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:05.630591 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-69d1e341-1f7d-4af0-991d-407327423e45 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:28:05.638474 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-69d1e341-1f7d-4af0-991d-407327423e45 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0" status: 200 len: 1314 microversion: 2.1 time: 0.152049 Sep 04 16:28:05.647939 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 636/1266] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:28:05 2022] GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:28:06.660317 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-878531eb-9032-44c6-969a-4d899d4b91bf tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:28:06.660850 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-878531eb-9032-44c6-969a-4d899d4b91bf tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: b7073718-c360-4e5b-a449-1b9248d5beb0] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:28:06.667562 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-878531eb-9032-44c6-969a-4d899d4b91bf tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:06.668033 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-878531eb-9032-44c6-969a-4d899d4b91bf tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:06.668462 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-878531eb-9032-44c6-969a-4d899d4b91bf tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:06.669136 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-878531eb-9032-44c6-969a-4d899d4b91bf tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:06.669601 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-878531eb-9032-44c6-969a-4d899d4b91bf tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:06.670022 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-878531eb-9032-44c6-969a-4d899d4b91bf tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:06.809842 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-878531eb-9032-44c6-969a-4d899d4b91bf tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:28:06.817827 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-878531eb-9032-44c6-969a-4d899d4b91bf tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0" status: 200 len: 1314 microversion: 2.1 time: 0.161396 Sep 04 16:28:06.818393 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 631/1267] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:28:06 2022] GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:28:07.743079 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [req-cd174e9f-6aa6-462d-a90c-4d63043e29e7 req-a2916fe8-c1f7-43be-adfa-4c7a246dba89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7073718-c360-4e5b-a449-1b9248d5beb0", "name": "network-vif-plugged", "status": "completed", "tag": "a0ab2bbe-fa90-4418-b394-464952edf32c"}]} {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:28:07.749013 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell0:SELECT=2 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:28:07.754226 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-cd174e9f-6aa6-462d-a90c-4d63043e29e7 req-a2916fe8-c1f7-43be-adfa-4c7a246dba89 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:07.754694 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-cd174e9f-6aa6-462d-a90c-4d63043e29e7 req-a2916fe8-c1f7-43be-adfa-4c7a246dba89 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:07.756980 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [req-cd174e9f-6aa6-462d-a90c-4d63043e29e7 req-a2916fe8-c1f7-43be-adfa-4c7a246dba89 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:07.768406 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.compute.server_external_events [req-cd174e9f-6aa6-462d-a90c-4d63043e29e7 req-a2916fe8-c1f7-43be-adfa-4c7a246dba89 service nova] Creating event network-vif-plugged:a0ab2bbe-fa90-4418-b394-464952edf32c for instance b7073718-c360-4e5b-a449-1b9248d5beb0 on hv-cinder-85236 Sep 04 16:28:07.773360 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [req-cd174e9f-6aa6-462d-a90c-4d63043e29e7 req-a2916fe8-c1f7-43be-adfa-4c7a246dba89 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034086 Sep 04 16:28:07.773959 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 637/1268] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:28:07.840669 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-f64c5d0f-83d1-407b-b94c-8afabcae9a6c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:28:07.841254 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-f64c5d0f-83d1-407b-b94c-8afabcae9a6c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: b7073718-c360-4e5b-a449-1b9248d5beb0] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:28:07.843812 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=2 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:28:07.844468 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell0:SELECT=6 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:28:07.852837 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f64c5d0f-83d1-407b-b94c-8afabcae9a6c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:07.853322 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f64c5d0f-83d1-407b-b94c-8afabcae9a6c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:07.853791 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f64c5d0f-83d1-407b-b94c-8afabcae9a6c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:07.854507 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f64c5d0f-83d1-407b-b94c-8afabcae9a6c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:07.855016 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f64c5d0f-83d1-407b-b94c-8afabcae9a6c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:07.855859 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-f64c5d0f-83d1-407b-b94c-8afabcae9a6c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:07.997675 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-f64c5d0f-83d1-407b-b94c-8afabcae9a6c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:28:08.000753 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:28:08.006999 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-f64c5d0f-83d1-407b-b94c-8afabcae9a6c tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0" status: 200 len: 1314 microversion: 2.1 time: 0.170564 Sep 04 16:28:08.007569 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 632/1269] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:28:07 2022] GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:28:09.030638 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-426f840b-48e1-40c7-865d-ced2483272bb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:28:09.031325 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-426f840b-48e1-40c7-865d-ced2483272bb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: b7073718-c360-4e5b-a449-1b9248d5beb0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:28:09.033998 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:28:09.039293 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-426f840b-48e1-40c7-865d-ced2483272bb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:09.039769 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-426f840b-48e1-40c7-865d-ced2483272bb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:09.040201 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-426f840b-48e1-40c7-865d-ced2483272bb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:09.040921 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-426f840b-48e1-40c7-865d-ced2483272bb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:09.041378 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-426f840b-48e1-40c7-865d-ced2483272bb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:09.041924 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-426f840b-48e1-40c7-865d-ced2483272bb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:09.046747 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG dbcounter [-] [121040] Writing DB stats nova_cell1:SELECT=67 {{(pid=121040) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:28:09.172493 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-426f840b-48e1-40c7-865d-ced2483272bb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:28:09.180570 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-426f840b-48e1-40c7-865d-ced2483272bb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0" status: 200 len: 1314 microversion: 2.1 time: 0.154803 Sep 04 16:28:09.181191 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 638/1270] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:28:09 2022] GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:28:10.204440 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-164bc2ca-6f5d-4a2a-9972-16b3d1d84ab6 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:28:10.205144 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-164bc2ca-6f5d-4a2a-9972-16b3d1d84ab6 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: b7073718-c360-4e5b-a449-1b9248d5beb0] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:28:10.207594 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG dbcounter [-] [121041] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121041) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 04 16:28:10.212653 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-164bc2ca-6f5d-4a2a-9972-16b3d1d84ab6 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:10.218472 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-164bc2ca-6f5d-4a2a-9972-16b3d1d84ab6 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:10.218472 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-164bc2ca-6f5d-4a2a-9972-16b3d1d84ab6 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:10.218472 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-164bc2ca-6f5d-4a2a-9972-16b3d1d84ab6 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:10.218472 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-164bc2ca-6f5d-4a2a-9972-16b3d1d84ab6 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:10.218964 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-164bc2ca-6f5d-4a2a-9972-16b3d1d84ab6 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:10.345950 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-164bc2ca-6f5d-4a2a-9972-16b3d1d84ab6 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:28:10.353916 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-164bc2ca-6f5d-4a2a-9972-16b3d1d84ab6 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0" status: 200 len: 1498 microversion: 2.1 time: 0.154075 Sep 04 16:28:10.354970 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 633/1271] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:28:10 2022] GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0 => generated 1498 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:28:11.160009 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-857344e3-34a3-4647-8668-8cf34da09d9a tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:28:11.160568 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-857344e3-34a3-4647-8668-8cf34da09d9a tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: b7073718-c360-4e5b-a449-1b9248d5beb0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:28:11.167420 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-857344e3-34a3-4647-8668-8cf34da09d9a tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:11.167891 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-857344e3-34a3-4647-8668-8cf34da09d9a tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:11.168316 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-857344e3-34a3-4647-8668-8cf34da09d9a tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:11.168990 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-857344e3-34a3-4647-8668-8cf34da09d9a tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:11.169434 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-857344e3-34a3-4647-8668-8cf34da09d9a tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:11.169890 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-857344e3-34a3-4647-8668-8cf34da09d9a tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:11.195895 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-857344e3-34a3-4647-8668-8cf34da09d9a tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: b7073718-c360-4e5b-a449-1b9248d5beb0] Going to try to terminate instance {{(pid=121040) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 04 16:28:11.446619 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-857344e3-34a3-4647-8668-8cf34da09d9a tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0" status: 204 len: 0 microversion: 2.1 time: 0.290842 Sep 04 16:28:11.447202 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 639/1272] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Sep 4 16:28:11 2022] DELETE /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 04 16:28:11.455444 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-42b76e66-92c2-482e-ae3a-5ea275688203 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:28:11.456073 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-42b76e66-92c2-482e-ae3a-5ea275688203 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: b7073718-c360-4e5b-a449-1b9248d5beb0] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:28:11.462809 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-42b76e66-92c2-482e-ae3a-5ea275688203 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:11.463283 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-42b76e66-92c2-482e-ae3a-5ea275688203 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:11.463713 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-42b76e66-92c2-482e-ae3a-5ea275688203 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:11.464391 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-42b76e66-92c2-482e-ae3a-5ea275688203 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:11.464837 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-42b76e66-92c2-482e-ae3a-5ea275688203 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:11.465251 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-42b76e66-92c2-482e-ae3a-5ea275688203 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:11.598881 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.policy [None req-42b76e66-92c2-482e-ae3a-5ea275688203 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121041) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:28:11.606508 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-42b76e66-92c2-482e-ae3a-5ea275688203 tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0" status: 200 len: 1504 microversion: 2.1 time: 0.155058 Sep 04 16:28:11.611347 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 634/1273] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:28:11 2022] GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:28:12.632229 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-69375936-ee66-416f-8f97-5ec91b48611f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:28:12.632894 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-69375936-ee66-416f-8f97-5ec91b48611f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: b7073718-c360-4e5b-a449-1b9248d5beb0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:28:12.639269 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69375936-ee66-416f-8f97-5ec91b48611f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:12.639748 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69375936-ee66-416f-8f97-5ec91b48611f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:12.640180 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69375936-ee66-416f-8f97-5ec91b48611f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:12.640865 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69375936-ee66-416f-8f97-5ec91b48611f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:12.641313 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69375936-ee66-416f-8f97-5ec91b48611f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:12.641798 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-69375936-ee66-416f-8f97-5ec91b48611f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:12.777878 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-69375936-ee66-416f-8f97-5ec91b48611f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:28:12.786088 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-69375936-ee66-416f-8f97-5ec91b48611f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0" status: 200 len: 1504 microversion: 2.1 time: 0.158425 Sep 04 16:28:12.786666 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 640/1274] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:28:12 2022] GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:28:13.295107 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [req-56a9aed7-0ed2-43bd-b09f-54fcf3265d8c req-3da46620-928f-4b6a-9a33-ea2fe6758375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7073718-c360-4e5b-a449-1b9248d5beb0", "name": "network-vif-deleted", "tag": "a0ab2bbe-fa90-4418-b394-464952edf32c"}]} {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 04 16:28:13.305853 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-56a9aed7-0ed2-43bd-b09f-54fcf3265d8c req-3da46620-928f-4b6a-9a33-ea2fe6758375 service nova] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:13.307174 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-56a9aed7-0ed2-43bd-b09f-54fcf3265d8c req-3da46620-928f-4b6a-9a33-ea2fe6758375 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:13.307174 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [req-56a9aed7-0ed2-43bd-b09f-54fcf3265d8c req-3da46620-928f-4b6a-9a33-ea2fe6758375 service nova] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:13.319451 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.compute.server_external_events [req-56a9aed7-0ed2-43bd-b09f-54fcf3265d8c req-3da46620-928f-4b6a-9a33-ea2fe6758375 service nova] Creating event network-vif-deleted:a0ab2bbe-fa90-4418-b394-464952edf32c for instance b7073718-c360-4e5b-a449-1b9248d5beb0 on hv-cinder-85236 Sep 04 16:28:13.324666 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [req-56a9aed7-0ed2-43bd-b09f-54fcf3265d8c req-3da46620-928f-4b6a-9a33-ea2fe6758375 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033432 Sep 04 16:28:13.325264 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 635/1275] 10.222.0.39 () {64 vars in 1317 bytes} [Sun Sep 4 16:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 04 16:28:13.809516 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.api.openstack.wsgi [None req-ec0901bd-4f86-48b4-be43-d16ffb463e0f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121040) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:28:13.810272 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.compute.api [None req-ec0901bd-4f86-48b4-be43-d16ffb463e0f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: b7073718-c360-4e5b-a449-1b9248d5beb0] Fetching instance by UUID {{(pid=121040) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:28:13.817413 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec0901bd-4f86-48b4-be43-d16ffb463e0f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:13.817921 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec0901bd-4f86-48b4-be43-d16ffb463e0f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:13.818351 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec0901bd-4f86-48b4-be43-d16ffb463e0f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:13.819033 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec0901bd-4f86-48b4-be43-d16ffb463e0f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:13.819482 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec0901bd-4f86-48b4-be43-d16ffb463e0f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:13.819898 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec0901bd-4f86-48b4-be43-d16ffb463e0f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:13.851173 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec0901bd-4f86-48b4-be43-d16ffb463e0f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:13.851638 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec0901bd-4f86-48b4-be43-d16ffb463e0f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:13.852067 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG oslo_concurrency.lockutils [None req-ec0901bd-4f86-48b4-be43-d16ffb463e0f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121040) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:13.852504 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.objects.instance [None req-ec0901bd-4f86-48b4-be43-d16ffb463e0f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lazy-loading 'fault' on Instance uuid b7073718-c360-4e5b-a449-1b9248d5beb0 {{(pid=121040) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 04 16:28:13.894400 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: DEBUG nova.policy [None req-ec0901bd-4f86-48b4-be43-d16ffb463e0f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb853b035f424dea91cc745a6322b377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68aaa192d3e244f6984f14a8eb59f050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121040) authorize /opt/stack/nova/nova/policy.py:199}} Sep 04 16:28:13.902113 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: INFO nova.api.openstack.requestlog [None req-ec0901bd-4f86-48b4-be43-d16ffb463e0f tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0" status: 200 len: 1304 microversion: 2.1 time: 0.096533 Sep 04 16:28:13.902903 dv-cinder-852364-6-iscsi devstack@n-api.service[121040]: [pid: 121040|app: 0|req: 641/1276] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:28:13 2022] GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 04 16:28:14.926163 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-46923110-0028-42bf-976f-ddeef6c378cb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Calling method '>' {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 04 16:28:14.926849 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.compute.api [None req-46923110-0028-42bf-976f-ddeef6c378cb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] [instance: b7073718-c360-4e5b-a449-1b9248d5beb0] Fetching instance by UUID {{(pid=121041) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 04 16:28:14.932905 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46923110-0028-42bf-976f-ddeef6c378cb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:14.933381 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46923110-0028-42bf-976f-ddeef6c378cb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:14.933831 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46923110-0028-42bf-976f-ddeef6c378cb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:14.934510 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46923110-0028-42bf-976f-ddeef6c378cb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Acquiring lock "a86cec77-539a-4bf3-943b-16bf2a859513" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 04 16:28:14.934954 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46923110-0028-42bf-976f-ddeef6c378cb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 04 16:28:14.935372 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG oslo_concurrency.lockutils [None req-46923110-0028-42bf-976f-ddeef6c378cb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Lock "a86cec77-539a-4bf3-943b-16bf2a859513" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121041) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 04 16:28:14.949280 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.wsgi [None req-46923110-0028-42bf-976f-ddeef6c378cb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] HTTP exception thrown: Instance b7073718-c360-4e5b-a449-1b9248d5beb0 could not be found. Sep 04 16:28:14.950979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-46923110-0028-42bf-976f-ddeef6c378cb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Request method failure captured: Sep 04 16:28:14.950979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: request: GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0 HTTP/1.1 Sep 04 16:28:14.950979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept: application/json Sep 04 16:28:14.950979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Accept-Encoding: identity Sep 04 16:28:14.950979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Connection: close Sep 04 16:28:14.950979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Length: 0 Sep 04 16:28:14.950979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Content-Type: application/json Sep 04 16:28:14.950979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Host: 10.222.0.39 Sep 04 16:28:14.950979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: Openstack-System-Scope: None Sep 04 16:28:14.950979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: User-Agent: python-urllib3/1.26.12 Sep 04 16:28:14.950979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Auth-Token: gAAAAABjFNH4jeeg2Tq8HnIOM_gTcUD-uopzSY26UHocsS0e1uzl-qXjyAi-1eyz6yKg-w8yr6BO9YF5wAnYwp90zHAeyezIlQVaA3JU9tj6hixTZtkLecF8SVyQlt9oXojAZxqSjzh6MuApFKVjOpKqxl2RRyj9q6Em6V9JK37nEHyzud1aUA8 Sep 04 16:28:14.950979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Id: None Sep 04 16:28:14.950979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Domain-Name: None Sep 04 16:28:14.950979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Identity-Status: Confirmed Sep 04 16:28:14.950979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Is-Admin-Project: True Sep 04 16:28:14.950979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Id: default Sep 04 16:28:14.950979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Domain-Name: Default Sep 04 16:28:14.950979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Id: 68aaa192d3e244f6984f14a8eb59f050 Sep 04 16:28:14.950979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Project-Name: tempest-VolumesActionsTest-336135920 Sep 04 16:28:14.950979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Role: reader,member Sep 04 16:28:14.950979 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Roles: reader,member Sep 04 16:28:14.952766 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/68aaa192d3e244f6984f14a8eb59f050"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/68aaa192d3e244f6984f14a8eb59f050"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:8080/v1/AUTH_68aaa192d3e244f6984f14a8eb59f050", "adminURL": "http://10.222.0.39:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/68aaa192d3e244f6984f14a8eb59f050"}]}] Sep 04 16:28:14.952766 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant: tempest-VolumesActionsTest-336135920 Sep 04 16:28:14.952766 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Id: 68aaa192d3e244f6984f14a8eb59f050 Sep 04 16:28:14.952766 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-Tenant-Name: tempest-VolumesActionsTest-336135920 Sep 04 16:28:14.952766 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User: tempest-VolumesActionsTest-336135920-project Sep 04 16:28:14.952766 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Id: default Sep 04 16:28:14.952766 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Domain-Name: Default Sep 04 16:28:14.952766 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Id: bb853b035f424dea91cc745a6322b377 Sep 04 16:28:14.952766 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: X-User-Name: tempest-VolumesActionsTest-336135920-project Sep 04 16:28:14.952766 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: method: > Sep 04 16:28:14.952766 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: exception: Instance b7073718-c360-4e5b-a449-1b9248d5beb0 could not be found. Sep 04 16:28:14.952766 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: action_args: {'id': 'b7073718-c360-4e5b-a449-1b9248d5beb0'} Sep 04 16:28:14.953844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: {{(pid=121041) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 04 16:28:14.953844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:28:14.953844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 04 16:28:14.953844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 04 16:28:14.953844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 04 16:28:14.953844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 04 16:28:14.953844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 04 16:28:14.953844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 04 16:28:14.953844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 04 16:28:14.953844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 04 16:28:14.953844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7073718-c360-4e5b-a449-1b9248d5beb0 could not be found. Sep 04 16:28:14.953844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:28:14.953844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:28:14.953844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:28:14.953844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:28:14.953844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:28:14.953844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:28:14.953844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 04 16:28:14.953844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 04 16:28:14.953844 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 04 16:28:14.956280 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 04 16:28:14.956280 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 04 16:28:14.956280 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 04 16:28:14.956280 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 04 16:28:14.956280 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 04 16:28:14.956280 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 04 16:28:14.956280 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 04 16:28:14.956280 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7073718-c360-4e5b-a449-1b9248d5beb0 could not be found. Sep 04 16:28:14.956280 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:28:14.956280 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 04 16:28:14.956280 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:28:14.956280 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 04 16:28:14.956280 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 04 16:28:14.956280 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 04 16:28:14.956280 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 04 16:28:14.956280 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 04 16:28:14.956280 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7073718-c360-4e5b-a449-1b9248d5beb0 could not be found. Sep 04 16:28:14.956280 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: ERROR nova.api.openstack.wsgi Sep 04 16:28:14.957935 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: DEBUG nova.api.openstack.wsgi [None req-46923110-0028-42bf-976f-ddeef6c378cb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] Returning 404 to user: Instance b7073718-c360-4e5b-a449-1b9248d5beb0 could not be found. {{(pid=121041) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 04 16:28:14.957935 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: INFO nova.api.openstack.requestlog [None req-46923110-0028-42bf-976f-ddeef6c378cb tempest-VolumesActionsTest-336135920 tempest-VolumesActionsTest-336135920-project] 10.222.0.39 "GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0" status: 404 len: 111 microversion: 2.1 time: 0.031056 Sep 04 16:28:14.957935 dv-cinder-852364-6-iscsi devstack@n-api.service[121041]: [pid: 121041|app: 0|req: 636/1277] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Sep 4 16:28:14 2022] GET /compute/v2.1/servers/b7073718-c360-4e5b-a449-1b9248d5beb0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)